-- Logs begin at Mon 2022-02-21 09:30:40 UTC, end at Mon 2022-02-21 10:30:24 UTC. -- Feb 21 09:57:10.986366 dv-cinder-830091-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 21 09:57:10.994637 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Feb 21 09:57:10 2022] *** Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: nodename: dv-cinder-830091-1-iscsi Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: machine: x86_64 Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: clock source: unix Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: pcre jit disabled Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: detected number of CPU cores: 4 Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: current working directory: / Feb 21 09:57:10.996635 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: detected binary path: /usr/bin/uwsgi-core Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: your processes number limit is 47680 Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: your memory page size is 4096 bytes Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: detected max file descriptor number: 2048 Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: lock engine: pthread robust mutexes Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: thunder lock: enabled Feb 21 09:57:10.997209 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 21 09:57:11.001096 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 21 09:57:11.045382 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: Python main interpreter initialized at 0x55b267a089c0 Feb 21 09:57:11.045382 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: python threads support enabled Feb 21 09:57:11.045382 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: your server socket listen backlog is limited to 100 connections Feb 21 09:57:11.045382 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: your mercy for graceful operations on workers is 90 seconds Feb 21 09:57:11.045733 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: mapped 403077 bytes (393 KB) for 2 cores Feb 21 09:57:11.045934 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: *** Operational MODE: preforking *** Feb 21 09:57:11.046119 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: *** uWSGI is running in multiple interpreter mode *** Feb 21 09:57:11.046119 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: spawned uWSGI master process (pid: 79416) Feb 21 09:57:11.046316 dv-cinder-830091-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 21 09:57:11.048061 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: spawned uWSGI worker 1 (pid: 79432, cores: 1) Feb 21 09:57:11.048551 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: spawned uWSGI worker 2 (pid: 79433, cores: 1) Feb 21 09:57:11.048829 dv-cinder-830091-1-iscsi devstack@keystone.service[79416]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 21 09:57:17.111420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:57:17.111420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: from cryptography.utils import int_from_bytes Feb 21 09:57:17.112599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:57:17.112599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: from cryptography.utils import int_from_bytes Feb 21 09:57:17.116311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:57:17.116311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: from cryptography.utils import int_from_bytes Feb 21 09:57:17.116788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 21 09:57:17.116788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: from cryptography.utils import int_from_bytes Feb 21 09:57:17.160201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 09:57:17.160677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 09:57:17.161041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] command line args: [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 09:57:17.161512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 09:57:17.161863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ================================================================================ {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 09:57:17.162290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] admin_token = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.162702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] config_dir = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.163061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.163412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] config_source = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.163761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] debug = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.163856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 21 09:57:17.164066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 21 09:57:17.164328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] command line args: [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 21 09:57:17.164646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.165037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 21 09:57:17.165483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ================================================================================ {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 21 09:57:17.166037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.166155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] admin_token = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.166231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.166488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.166748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.166989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.167174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_config_append = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.167358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.167540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_dir = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.167721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_file = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.167955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] config_dir = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.168050 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.168208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.168459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.168706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.168877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.169034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.169351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] config_source = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.169449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.169716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] debug = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.169952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.170101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.170469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.170624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.170828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.171110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.171256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.171602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.171696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.172007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.172160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.172378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_config_append = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.172655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.172785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.173003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_dir = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.173309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_file = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.173412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.173719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.173910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.174150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.174444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.174539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.174891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.175180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.175429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.175523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.175820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] publish_errors = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.175928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.176257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.176391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.176668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.176883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.177099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.177355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.177508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.177855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.177970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.178272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.178442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.178696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.178948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] standard_threads = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.179151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.179444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.179815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.179914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.180178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] publish_errors = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.180416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.180589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.181410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] use_journal = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.181505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.181805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.181975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] use_json = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.182172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.182457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] use_stderr = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.182552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.182773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] standard_threads = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] use_syslog = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.183949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] use_journal = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.184040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] use_json = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.184399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.184600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] use_stderr = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.184764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.185123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.185282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] use_syslog = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.185554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.185792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 21 09:57:17.185986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.186327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.186473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.186750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.186982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.187161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.187524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.187737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.187949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.188247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.188344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.188673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.188853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.189109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.189400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.189495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.189832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.189999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.190251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.190522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.190656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.191006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.191146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.191430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.191654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.191848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.192180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.192292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.192595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.192774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.193030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.193325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.193481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.193825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.193920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.194217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.194423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.194618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.194944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.195116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.195363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.195622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.195778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.196119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.196307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.197088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.197429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.197618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.197849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.198147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.198241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.198571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.198721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.198990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.199259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.199430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.199745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.199966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.200149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.200472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.200610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.200882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.201173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.201281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.201609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.201933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.202139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.202363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.202682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.203019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.203124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.203407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.203736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.203965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.204173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.204505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.204813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.204907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.205267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.205566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.205673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.205986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.206219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.206395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.206726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.206838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.207279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.207560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.207693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.208089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.208335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.208430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.208735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.208952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.209198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.209492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.209602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.209913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.210144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.210321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.210668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.210764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.211097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.211268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.211509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.211794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.211890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.212282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.212392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.212681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.212890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.213119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.213442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.213552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.213880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.214054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.214302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.214574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.214705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.215057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.215213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.215480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.215721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.215902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.216238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.216332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.216643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.216837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.217102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.217369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.217561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.217880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.217976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.218299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.218491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.218721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.218997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.219132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.219474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.219623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.219887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.220070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.220303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.220559 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.220811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.221078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.221272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.221441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.221712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.221964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.222209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.222423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.222591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.222775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.222952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.223200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.223485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.223747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.223848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.224095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.224352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.224608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.224841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.224936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.225127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.225343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.225597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.225840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.226082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.226289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.226381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.226569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.226813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.227059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.227300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.227564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.227660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.227838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.228081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.228330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.228573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.228824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.228910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.229110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.229338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.229580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.229815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.230988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.231229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.231481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.231695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.231780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.231968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.232232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.232476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.232712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.external = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.232935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.233020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.233277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.233516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.233752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.password = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.233997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] auth.token = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.234242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.234416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.234530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.234724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.234961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.235213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.235464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.235700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.235891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.235981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.236179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.236431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.236680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.236925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.237164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.237393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.237785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.external = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.237874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.238274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.238505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.238724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.239175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.239264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.239686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.239885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.240197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.240506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.password = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.240662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.241107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] auth.token = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.241210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.241414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.241689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.241933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.242179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.242375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.242460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.242673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.242911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.243165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.243938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.244164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.244250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.244434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.244682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.244922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.245216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.245463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.245550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.245715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.245959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.246201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.246441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.246696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.246783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.246949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.247167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.247420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.247675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.247911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.248113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.248199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.248450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.248617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.248869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.249149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.249408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.249633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.249741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.249912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.250152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.250392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.250626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.250866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.251066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.251151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.251316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.251563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.251856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.252094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.252190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.252368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.252598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.252980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.253209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.253359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.253577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.253828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.254063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.254306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.254517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.254603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.254850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.255094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.255345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.255591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.255778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.255863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.256072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.256327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.256562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.256799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.257291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.257379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.257586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.257831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.258073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.258313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.258550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.258765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.258898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.259599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.259837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.260088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.260339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.260591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.260678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.260845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.261097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.261316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.261555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.261795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.262029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.262236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.262321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.262518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.262770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.263984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.264225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.264465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.264702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.264941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.265027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.265269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.265517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.265776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.266976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.267225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.267469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.267703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.267885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.268048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.268292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.268549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.268799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.269039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.269172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.269352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.269570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.269819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.270070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.270341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.270427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.270620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.270862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] role.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.271113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] role.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.271346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.271600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.271763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.271854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.272089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.272338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.272586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.272837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.273035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.273153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.273406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.273647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.273896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.274147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.274316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.274408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.274672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.275064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.275151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.275345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.275601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.275853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.276105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.276357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.276595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.276822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.276917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.277132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.277355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.277638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.277878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.278117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.278216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.278385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.278619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.278871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.279112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.279339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.279435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.279605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.279807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.280047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.280294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.280533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.280768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.280855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.281021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.281298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.281547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.281797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.282997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.283247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.283451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.283537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.283704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.284016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.284288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.connection = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.284494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.284591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.284773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.285018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.285286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.285523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.285765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.286052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.286138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.286317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.286568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.286809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.287062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.287290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.287376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.287540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.287777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.288971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 09:57:17.289415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.289860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.290340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.290772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.291202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.291642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.292075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.292507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.292970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.293464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.293887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.294311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.294732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.295168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.295635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.296074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.296521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.296959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.297446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.297877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.298321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.298743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.299169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.299608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.300034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.300468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.300908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.301366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.301788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.302224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.302673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.303100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.303550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.303990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.304409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.304843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.305339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.306305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.306750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.307190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.307615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.308044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.308482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.308920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.309378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.309800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.310239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.310676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.311105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.311531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.311986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.312408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.312841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.313315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.313739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.314177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.314629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.315068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.315492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.315911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.316337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.316762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.317223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.317646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.318092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.318530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.318964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.319403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.319857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.320279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.320718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.321118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.321966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.322067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.322261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.322698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.323138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.323565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.324004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.324453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.324882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.325350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.325775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.326221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.326650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.327091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.327516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.327956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.328387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.328809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.329272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.329720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.330157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.330593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.331011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.331194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.331625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.332079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.332504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.332946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.333407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.333845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.334270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] role.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.334736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] role.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.335157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.335595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.336032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.336473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.336910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.337413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.337853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.338290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.338729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.339153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.339605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.340043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.340495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.340931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.341571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.342002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.342460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.342909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.343350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.343791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.344262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.344716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.345227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.345662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.346085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.346507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.346937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.347379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.347841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.348279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.348706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.349156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.349580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.350005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.350448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.350884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.351310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.351757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.352194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.352721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.353313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.353757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.354200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.354629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.355059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.355485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.355941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.356383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.356802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.357270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.357767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.358223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.connection = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.358695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.359237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.359668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.360105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.360532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.360962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.361436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.361882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.362043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.362268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.362683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.363115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.363553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.363990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.364446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.364872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.365331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.365754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.366183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.366625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 21 09:57:17.366981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79433) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 21 09:57:17.394882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.395430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.395862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.405121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.421279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.425609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.426053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.471643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.484110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.484356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.509825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.510399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.552562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.552858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.553038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.553232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.553456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.553671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.554967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.555411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.556374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.556783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.557218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.557623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.581142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.581323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.581658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.581753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.581968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.582189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.582405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.582620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.582928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.583332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.583735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.584148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.584556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.584958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.594763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.596783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.608950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.609285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.609501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.609598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.609775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.609974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.610195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.610415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.610778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.611189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.611599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.612016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.612414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.612812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79433) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 21 09:57:17.628770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.628963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:57:17.629344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.629549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:57:17.629866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.630049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.630318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.630584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.630822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:57:17.630912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.631439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.631822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 21 09:57:17.632751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.633255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.633702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.634181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.644296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.644592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.644863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.645169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.646150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.646641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.647096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.647599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.653504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.656331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.656940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.657244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.657528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.657807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.658090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.658351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.658621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.658894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.659177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.659451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.659722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.662405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.662920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.663390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.663920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.664390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.664837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.665855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.666321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.666792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.667250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.667706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.690868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.692491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.692767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.696041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.698046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.698162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.698437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.698712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.699072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.704489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.704988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.705494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.706074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.706409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.710799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.711081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.711361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.711635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.711945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.712216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.712480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.712745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.715137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.715621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.720210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.720697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.721193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.721658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.722119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.722598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.723052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.723505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.733329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.733617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.738754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.742531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.742826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.744445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.744929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.748450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.749845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.752023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.753942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.754431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.755676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.755969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.756250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.756529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.756825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.757398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.761356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.765160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.768962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.769493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.769976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.770466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.770935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.771399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.777044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.777477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.777689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.777925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.785711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.787387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.787657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.791210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.791485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.791898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.792228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.792504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.794388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.794895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.795354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.795821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.803744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.805638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.805764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.805990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.806271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.806545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.806819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.807027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.807117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.807348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.810554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.811040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.811645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.812134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.812602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.825965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.826518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.826634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.827129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.827595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.828087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.828555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.829028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.829880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.833196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.834782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.850086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.854419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.858176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.860113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.943876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.944230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.944453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.952508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.954151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.958967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.959268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.959547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.959821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.968040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.968634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.969127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.969480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.969780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.970055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.977125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.977789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.978067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.978341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.978611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.978878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.979159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.979423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.979798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.980067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.980340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.980607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.980902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.981263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.981521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.981781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.985124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.985608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.986087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.986545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.996321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:17.996837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:17.997341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.005244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79433) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 21 09:57:18.005786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.006262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.006719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.007424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.007884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.008372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.009529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.009996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.010462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.010922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.011386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.011855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.012304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79433) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 21 09:57:18.021499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b267a089c0 pid: 79432 (default app) Feb 21 09:57:18.025025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beebd87-133a-427a-9069-3306d7aa96c1 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:18.025335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beebd87-133a-427a-9069-3306d7aa96c1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:18.025609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beebd87-133a-427a-9069-3306d7aa96c1 None None] PATH_INFO: `/v3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:18.029921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Mon Feb 21 09:57:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:18.051492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b267a089c0 pid: 79433 (default app) Feb 21 09:57:26.312997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:26.313581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:26.313681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:26.315980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:26.324934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:26.325504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:26.325597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:26.355720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG oslo_db.sqlalchemy.engines [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79433) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 09:57:26.537242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG passlib.handlers.bcrypt [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79433) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 09:57:26.537668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG passlib.handlers.bcrypt [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79433) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 09:57:26.593027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:26.594642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:26.714568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1/3] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:26.848951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:26.881900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG oslo_db.sqlalchemy.engines [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 21 09:57:27.008388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2496e45-0a92-4fb9-84b2-d9926fb599e0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:27.012609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:27.013342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:27.013623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:27.013894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:27.021852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:27.071712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 09:57:27.072050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd551f6-0f34-449d-8735-1eed4ed84675 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:27.081183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 3/4] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:57:27.087608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:27.101750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de3b03-e0f8-464d-98f9-af386e14cb2c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:27.106664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:27.107742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:27.108022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:27.108292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] PATH_INFO: `/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:27.109904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] RBAC: Authorizing `identity:get_project(project_id=0eb1e05c525c48b0a68ad872b0aea42a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:27.161975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 21 09:57:27.162310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e787063-df32-4ab9-af15-a2d032f0aef7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:27.166934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 2/5] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:27 2022] GET /identity/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:29.442271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c455e-5584-489c-87ac-a376db8f42fb None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:29.442772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c455e-5584-489c-87ac-a376db8f42fb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:29.442772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c455e-5584-489c-87ac-a376db8f42fb None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:29.447584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 4/6] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:29.453176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:29.453600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:29.453714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:29.474261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:29.475748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:29.484007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 3/7] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:29.507222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c455e-5584-489c-87ac-a376db8f42fb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:29.519271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c455e-5584-489c-87ac-a376db8f42fb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:29.523529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:29.524160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:29.524443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:29.524719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:29.532204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:29.533982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8fe63-d6ed-4fd7-9823-dc3c2eddf3fa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:29.543222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 5/8] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:29.548282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:29.557627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f23ea7-6359-4934-bbc2-8b62e5154eec None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:29.561923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:29.562760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:29.563036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:29.563305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:29.564653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:29.566491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b99f9-22cd-44ae-bca3-b0d9ba93fef5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:29.568017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 4/9] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:29 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:31.900529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6db4-b559-4712-854f-4038c91c94cd None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:31.901047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6db4-b559-4712-854f-4038c91c94cd None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:31.901182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd6db4-b559-4712-854f-4038c91c94cd None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:31.902868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:31.908069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:31.908507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:31.908627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:31.926608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:31.927811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:31.936270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 5/11] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:31.955337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416067-0668-4414-8376-c2f5ba263484 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:31.955627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416067-0668-4414-8376-c2f5ba263484 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:31.955906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41416067-0668-4414-8376-c2f5ba263484 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:31.957698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 7/12] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:31.959418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:31.963028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:31.963318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:31.963599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:31.968581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03ea94-f7d6-403e-b49a-b311b8366b83 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:31.973157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:31.973919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:31.974195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:31.974466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:31.987507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:31.994847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:31.996019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 6/13] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:32.001615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.006849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG passlib.handlers.bcrypt [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79432) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 21 09:57:32.007554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG passlib.handlers.bcrypt [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79432) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 21 09:57:32.011073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931d31a-8ff4-48c3-a5bf-8a0227ea551d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.015396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.016003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.016277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.016547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.017312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:32.017615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.019353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:32.019353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:32.019353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:32.020224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.033076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:32.038276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.047588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb38106-55ee-4736-8a8a-2b973f4883c7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.051818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.052583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.052859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.053161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.054325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.054643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:32.056127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.056261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:32.057848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:32.062827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.073778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267245-0c6e-4f0e-8c1d-cda82052446a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.078111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.078857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.078986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:32.079137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.079411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.080574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.082278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.083833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:32.089944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.099403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ffd0b-ad4b-4aa1-a9c5-0a99a31ac5e8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.101140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.104541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.105543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.105829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.106106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.107084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.domain.id=default, user.id=27658e4102424ffd80d8ec01579038ea) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:32.107388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.109173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:32.109173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:32.109173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:32.110350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.111122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d909-5b26-43d1-86e6-c915db5aa9e7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.115535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.116154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.116435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.116709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.119126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 9/18] 10.222.0.73 () {56 vars in 1343 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/role_assignments?user.id=27658e4102424ffd80d8ec01579038ea&scope.domain.id=default&role.id=408af600f9f04514bc0631f4887e6d97 => generated 233 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:32.125728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.126757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40ac23-2698-46f9-a680-0895adff0a41 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.136984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 10/19] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:57:32.142882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:32.153698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575133a-266b-4b84-9fbe-bbc8bf19f41c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:32.158171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:32.158986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:32.159268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:32.159541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:32.160982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:32.162744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74198d-b51b-4d5b-a4cf-7bfbf3d06857 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:32.164412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 10/20] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:34.795353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfea2-9054-4953-a461-27b004477964 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:34.795889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfea2-9054-4953-a461-27b004477964 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:34.795889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfea2-9054-4953-a461-27b004477964 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:34.798098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 11/21] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:34.819364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:34.819896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:34.819896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:34.845342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:34.846877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:34.858621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 11/22] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:34.881326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfea2-9054-4953-a461-27b004477964 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:34.904674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfea2-9054-4953-a461-27b004477964 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:34.915488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:34.916284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:34.916560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:34.916833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:34.934435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:34.941286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:34.942680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 12/23] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:34.948750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:34.962984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221b077-4f40-43ed-a6ba-4ab4654f72d6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:34.971535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:34.972447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:34.973000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:34.973497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:34.974471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:34.975274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:34.976479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:34.976479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:34.976479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:34.977761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:34.998000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 12/24] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:35.003118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.018044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73807b0-7450-4390-9559-84a6c5badf39 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.028734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.029608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.029882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.030148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.033777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.035595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.037422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 13/25] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:35 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:35.042686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.053310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e60537-7864-4041-a2b0-f803dbf0e77c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.065023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.066173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.066651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.067135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.074024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.076102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c68fae-1092-422e-8d17-0747da07d54e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.078362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 13/26] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:35.083753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.096700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc20a6b-75ad-426d-aa23-eb724d4a83e7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.106131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.107237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.107659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.108093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] PATH_INFO: `/v3/domains/default/users/27658e4102424ffd80d8ec01579038ea/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.113823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=27658e4102424ffd80d8ec01579038ea, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.115015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:35.115015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:35.115015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:35.117281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.214351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a8b1-8ec7-4431-b110-5fe9ca1430db None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.215003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a8b1-8ec7-4431-b110-5fe9ca1430db None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.215515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a8b1-8ec7-4431-b110-5fe9ca1430db None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.217876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 14/27] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:35.228375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35d5a-b48f-401c-8e30-8444981929ae None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.228910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35d5a-b48f-401c-8e30-8444981929ae None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.229432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e35d5a-b48f-401c-8e30-8444981929ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.271460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-68e35d5a-b48f-401c-8e30-8444981929ae None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:35.273538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-68e35d5a-b48f-401c-8e30-8444981929ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:35.275303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 14/28] 10.222.0.73 () {58 vars in 1382 bytes} [Mon Feb 21 09:57:35 2022] PUT /identity/v3/domains/default/users/27658e4102424ffd80d8ec01579038ea/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:35.388147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 15/29] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 21 09:57:35.432209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.447807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5733-bea8-4e57-9e3a-7595dc2e9e80 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.455628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.456420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.456698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.456968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.462993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410abd7c-4bcb-404f-b050-4c0cfa7f8c9e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.463546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410abd7c-4bcb-404f-b050-4c0cfa7f8c9e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.464039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410abd7c-4bcb-404f-b050-4c0cfa7f8c9e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.466132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:35.473099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.473714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.474051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.474416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.476160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.509278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:57:35.509278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 15/31] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:35.510595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.514269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:35.515788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:35.528708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fd581-240e-47b0-911a-9e0a9dd1dbed admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.530405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 17/32] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:35.540150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.540824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.541118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.541392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.542129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:35.542432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.543533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:35.543533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:35.543533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:35.544423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.568770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.572754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 16/33] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:35.584350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.589615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139daebe-8d35-497d-92df-d9ba86db141b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.596640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6da8d7-532f-4d6c-b26b-d50127d455c1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.601555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.602732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.603052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.603285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.604038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.605069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:35.605069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:35.605069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:35.606097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.607724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.608438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.608723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.609261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.610082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.611149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:35.611149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:35.611149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:35.612465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a88d-044c-49e6-a2d4-f778e12e467a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.660868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 17/34] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/projects => generated 301 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:35.722028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93d8a-e0ff-46be-aa65-7069c842bb6f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.722359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93d8a-e0ff-46be-aa65-7069c842bb6f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.722583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d93d8a-e0ff-46be-aa65-7069c842bb6f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.724776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 18/35] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:35.733967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3fb43-d5a1-4240-b7df-f577e2328800 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.734259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3fb43-d5a1-4240-b7df-f577e2328800 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.734528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3fb43-d5a1-4240-b7df-f577e2328800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.767759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c4b3fb43-d5a1-4240-b7df-f577e2328800 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:35.769775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c4b3fb43-d5a1-4240-b7df-f577e2328800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:35.787623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 18/36] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/roles => generated 225 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:57:35.858727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 19/37] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:35.899701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:35.915915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a347-4158-4bf5-9ed3-cec775e2dff9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:35.925493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:35.926188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:35.926513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:35.926790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:35.927607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:35.929626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3966f8f-189e-4e44-9e07-81b098e4856e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:35.947674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 19/38] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 09:57:35 2022] POST /identity/v3/roles => generated 219 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:36.638903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751a7b8-5228-4f90-8b2b-5ec3d7cf1a69 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.639286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751a7b8-5228-4f90-8b2b-5ec3d7cf1a69 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.639576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751a7b8-5228-4f90-8b2b-5ec3d7cf1a69 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.641537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 20/39] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:36.646551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.646846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.647127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.666362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:36.667927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:36.670633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b659-97e4-4206-9004-abbb8f82d442 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.670926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b659-97e4-4206-9004-abbb8f82d442 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.671199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44b659-97e4-4206-9004-abbb8f82d442 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.673089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 21/40] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:36.675881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 20/41] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:36.677595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.677882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.678157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.695461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:36.696725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:36.698789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:36.704953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 22/42] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:36.708667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ec464-6ca2-4b95-aa78-ad874d1946a2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:36.713737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:36.714397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.714683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.714963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.715726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:36.717369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:36.729492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:36.731647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 21/43] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 09:57:36 2022] POST /identity/v3/roles => generated 223 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:57:36.738712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4aaff-16b5-4675-a7f6-248427348ee5 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:36.743470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:36.744281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.744562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.744837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.746106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:36.747873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357508f2-643c-4593-ada1-34bf56ef2459 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:36.749792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 23/44] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:36.755393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:36.765819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a6a18-0cde-475e-9e0f-b15007d188f1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:36.770452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:36.771139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:36.771421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:36.771696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:36.772427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:36.773487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:36.773487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:36.773487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:36.775265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdbf38-fbb9-491d-b02a-129e0d6151aa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:36.806337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:57:36 2022] POST /identity/v3/projects => generated 312 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:37.871944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce8e8-606f-4554-8b3d-c392daa3cd3f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:37.872456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce8e8-606f-4554-8b3d-c392daa3cd3f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:37.872558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ce8e8-606f-4554-8b3d-c392daa3cd3f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:37.874313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 24/46] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:37.879582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:37.879975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:37.880137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:37.897839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:37.899015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:37.955618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 23/47] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:37.978611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ce8e8-606f-4554-8b3d-c392daa3cd3f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:37.990761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ce8e8-606f-4554-8b3d-c392daa3cd3f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:37.995565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:37.996326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:37.996604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:37.996878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:38.006621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:38.013627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:38.014757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:38.020257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:38.029480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531793-bb3f-4717-b36e-ba2d7f668b25 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:38.033834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:38.034483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:38.034765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:38.035037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:38.035787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:38.036090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:38.037728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:38.046549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 24/49] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:38.051573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:38.062146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd98b6-15a0-4408-afb4-a289f817a9bc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:38.066628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:38.067461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:38.067739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:38.068014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:38.069304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:38.071156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:38.072728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 26/50] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:38 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:38.077926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:38.087827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33029d2b-6a17-419e-87a7-3bdfb09843dd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:38.092177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:38.092956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:38.093603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:38.093603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:38.094698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:38.096394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3d881-8143-41ce-9994-0b6b40cee6c2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:38.098139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 25/51] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:38.104142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:38.113635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287404e-90ae-4e53-b19b-a21c89b16819 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:38.117991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:38.119952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:38.120238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:38.120517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:38.121379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.domain.id=default, user.id=27658e4102424ffd80d8ec01579038ea) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:38.121691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:38.122769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:38.122769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:38.122769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:38.123854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bdc55-8c1f-40d9-9c54-75078796b3c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:38.130960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 27/52] 10.222.0.73 () {56 vars in 1343 bytes} [Mon Feb 21 09:57:38 2022] GET /identity/v3/role_assignments?user.id=27658e4102424ffd80d8ec01579038ea&scope.domain.id=default&role.id=408af600f9f04514bc0631f4887e6d97 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:39.109146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943447-0824-4cb1-bc13-23fb37df45e6 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:39.109572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943447-0824-4cb1-bc13-23fb37df45e6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:39.109715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943447-0824-4cb1-bc13-23fb37df45e6 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:39.111513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 26/53] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:39.116701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:39.117135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:39.117278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:39.136017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:39.137216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:39.144611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 28/54] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:39.167504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943447-0824-4cb1-bc13-23fb37df45e6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:39.179665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943447-0824-4cb1-bc13-23fb37df45e6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:39.183912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:39.184702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:39.184989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:39.185302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:39.186467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:39.188159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d953f-ddaf-4d31-977c-66b646de99b9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:39.189756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:39.194576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:39.203907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa0d3-5fab-4de7-8d01-89f04782cc36 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:39.208292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:39.208921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:39.209251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:39.209547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:39.210255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:39.212814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53d0b7-62bf-4fc0-a348-047b8a4b535c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:39.237621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 29/56] 10.222.0.73 () {60 vars in 1161 bytes} [Mon Feb 21 09:57:39 2022] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:41.533210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023887-1eb8-4df6-8b55-1d9d1e0cb12c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:41.533733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023887-1eb8-4df6-8b55-1d9d1e0cb12c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:41.533814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf023887-1eb8-4df6-8b55-1d9d1e0cb12c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:41.535558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 28/57] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:41.541297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:41.541723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:41.541854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:41.559492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:41.560769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:41.613876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 30/58] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:41.638913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf023887-1eb8-4df6-8b55-1d9d1e0cb12c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:41.650589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf023887-1eb8-4df6-8b55-1d9d1e0cb12c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:41.654760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:41.655518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:41.655798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:41.656072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:41.657241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:41.658896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665000b1-24d5-4f03-aac1-230b6689dccd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:41.660427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:41.665889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:41.674408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971c5d-47a1-4d1c-be98-371d44e259c3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:41.678700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:41.679331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:41.679609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:41.680474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:41.681212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:41.682206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:41.682206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:57:41.682206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:57:41.683397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b864-046f-4a9e-87ca-5db3904beb40 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:41.707058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 31/60] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:57:41 2022] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:45.294213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376545f2-2787-4122-b8a6-235c40ccb46a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.294213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376545f2-2787-4122-b8a6-235c40ccb46a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.294213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376545f2-2787-4122-b8a6-235c40ccb46a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.295822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 30/61] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:45.299737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddde9a-6681-418a-a951-01dece365934 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.300156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddde9a-6681-418a-a951-01dece365934 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.300358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddde9a-6681-418a-a951-01dece365934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.329188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8cddde9a-6681-418a-a951-01dece365934 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:45.330376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8cddde9a-6681-418a-a951-01dece365934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:45.344562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 32/62] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:45.353211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae79e2-863f-44fa-b1cc-551b3fd10118 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.353745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae79e2-863f-44fa-b1cc-551b3fd10118 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.354246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae79e2-863f-44fa-b1cc-551b3fd10118 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.356449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:45.361889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.362176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.362448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.369292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae79e2-863f-44fa-b1cc-551b3fd10118 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.396107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:45.397742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:45.400688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae79e2-863f-44fa-b1cc-551b3fd10118 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.409089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.409917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.410200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.410478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.412854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 33/64] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:45.434036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:45.437927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.442298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-333c9b10-57c2-497f-85fe-acae3dbd2e85 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:57:45.443541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 32/65] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:45.447858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad763-7fe2-4714-ac6b-ad37328240c8 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.448151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad763-7fe2-4714-ac6b-ad37328240c8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.448435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad763-7fe2-4714-ac6b-ad37328240c8 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.450200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 33/66] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:45.452594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b71c9-4a70-43d8-a102-69262d99e63e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.453954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad763-7fe2-4714-ac6b-ad37328240c8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.459316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.460348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.460848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.461383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.468084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad763-7fe2-4714-ac6b-ad37328240c8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.472677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:45.473166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.473801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.474086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.474369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.475119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.475429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.477587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bbad-65ad-4728-a0b1-973f47008261 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.481891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:45.486190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 34/67] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.487667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.488183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 34/68] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:57:45.488289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.488753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.489022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.503869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655bc-e41c-4e37-ac3e-680a21a181f5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.508910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.509771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.509884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:45.510311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.510728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.511372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:45.511780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.512222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.514105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.520713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 35/69] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:45.521669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.531699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 35/70] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.532080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410f99-4e29-486a-b93a-346d801ffb2d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.537156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.537471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.538566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.539673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.540188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.558547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.559412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633d2f9-55eb-4d5f-9ebd-944d14320fba admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.561413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.563412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 36/71] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.564372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.570290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.571627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.571627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.571818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.572961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.574798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.576007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec616ffe-54fb-4cc6-9760-4ecc2a1808f2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.581232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 36/72] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:45.582057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.586560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.587608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.588324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.588802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.593010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a8b22-440b-442d-9824-0ae8c31df143 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.597627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.598202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.598488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.598769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.603056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:45.607467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.609247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.611826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:45.613453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 37/73] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:45.618911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.625455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 37/74] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:45.626494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.628097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dede1f9-a67a-445e-bb89-308faa47b5d7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.635385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.636275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.636756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.637294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.641373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f269145-a5ae-4f55-b31a-335f80fe28b6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.646319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.646572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.647376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.647802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.648233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.649125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.649915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.650382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.652097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.658761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 38/75] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:45.659660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.666786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 38/76] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.667802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.674614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ee16c-7c9b-4101-bed5-08af63c161fc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.678227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffc31-d18d-47df-b064-73266ff54dfb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.679425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.680522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.680910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.681421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.682835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.684058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.684941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.685130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.685305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.685544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.686732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.687126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 39/77] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.688015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.688766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a920-6f27-4999-9030-03ebf2690790 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.690501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 39/78] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.691903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5efe8-c576-4f75-a043-5f7d5e7ca2a9 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.692586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5efe8-c576-4f75-a043-5f7d5e7ca2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.692869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5efe8-c576-4f75-a043-5f7d5e7ca2a9 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.694923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 40/79] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:45.695880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5efe8-c576-4f75-a043-5f7d5e7ca2a9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.699940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40c9b0-7263-4946-980a-c7aa8570590f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.704651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.705538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.705826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.706115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.707292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.709456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.711596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 40/80] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.712203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5efe8-c576-4f75-a043-5f7d5e7ca2a9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.712412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.717316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.718124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.718410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.718690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.719528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.719843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.721702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdd2c0-5b2c-4e94-85e2-78a3c0fee310 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.722242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73377b5-2f80-4bdd-bb80-03af84bf7938 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.727261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.727885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.737230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.737414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 41/81] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.737491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.737491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=27658e4102424ffd80d8ec01579038ea) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.737643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e175b-2821-4209-aa93-8ebdc514e38b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.737709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.737772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e175b-2821-4209-aa93-8ebdc514e38b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.737772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e175b-2821-4209-aa93-8ebdc514e38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.737892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.745557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 41/82] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/role_assignments?user.id=27658e4102424ffd80d8ec01579038ea&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.746567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.756027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f29e175b-2821-4209-aa93-8ebdc514e38b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:45.757628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f29e175b-2821-4209-aa93-8ebdc514e38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:45.762131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118236d-c2bc-4fcb-82eb-f6453add415f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.765932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 42/83] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:45.766877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.767503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5270964-e8ce-4332-9225-4c96f6a4f449 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.767606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.767791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5270964-e8ce-4332-9225-4c96f6a4f449 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.767923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.768136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.768466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5270964-e8ce-4332-9225-4c96f6a4f449 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.770864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 43/84] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:45.777797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.778463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.778892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.780367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.782233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.792550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 42/85] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:45.799898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.805732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:45.809283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:45.813440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7e4b-5a47-46c2-90dd-4f693db56b8f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.818253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.819142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.819427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.819699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.821154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.822239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 44/86] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:45.833084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.833274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.833274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 43/87] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:45.833274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.842564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40752756-c6aa-46e9-a5ba-9f8a2d0c53e8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.849330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60284909-7404-4f91-a828-3e9520eb5e8f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.852905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.853612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.853897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.854176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.855124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.855431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.857354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.861838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.863007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.863470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.863922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.864024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 44/88] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:45.864871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.865668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.867813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.869925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 45/89] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.884322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f0c53-601a-4ea3-8a76-9cecebe19a72 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.888760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.892048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.893212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.893646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.894088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.907849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:45.908885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ab221-d6dc-4cb2-aed7-830d42842ab9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.915457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:45.916789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.917166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 45/90] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:45.921126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.921126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.921126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.922298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.923538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.924488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.934853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c0fa3-b053-4f5b-910a-92ca1422c150 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.947815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.948619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.948909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.949235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.950128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:45.950446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:45.956079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:45.960129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 46/91] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:57:45 2022] POST /identity/v3/users => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:45.970223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 46/92] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:45.977768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:45.990260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa544c5-547b-4986-b7fc-0325df029725 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:45.995418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:45.996641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:45.997136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:45.997564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:45.999165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:46.001616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:46.003723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 47/93] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:45 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:46.011309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:46.023962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebca6f2-2c3d-4368-a998-ed0abeedeb0e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:46.029545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:46.030606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:46.031094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:46.031591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:46.041945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:46.044398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:46.055977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 47/94] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:46.061803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:46.075955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b09c3-81e5-4072-89d9-933d84012016 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:46.082735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:46.083915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:46.084375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:46.084851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] PATH_INFO: `/v3/projects/68a3884a068d43749f581aabc757e431` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:46.090054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] RBAC: Authorizing `identity:get_project(project_id=68a3884a068d43749f581aabc757e431)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:46.092165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419aa0c3-8510-48c1-8c86-7f54c347cc76 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:46.094246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 48/95] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:46 2022] GET /identity/v3/projects/68a3884a068d43749f581aabc757e431 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:46.100761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:46.115819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee616a25-da33-4b4a-a7e2-fa53643e8588 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:46.135026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:46.135745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:46.136024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:46.136344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:46.137228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=68a3884a068d43749f581aabc757e431, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:46.137596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:46.139612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2ca2-da08-42f3-927b-fb1ab83f3516 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:46.147762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 48/96] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:46 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=68a3884a068d43749f581aabc757e431&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:48.616152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50917-344c-4e25-bf6b-83a569e6cfa8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.617238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50917-344c-4e25-bf6b-83a569e6cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.617740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b50917-344c-4e25-bf6b-83a569e6cfa8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.619812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 49/97] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:48.625401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5000b-c03d-46f6-b042-c48255b075fa None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.626244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5000b-c03d-46f6-b042-c48255b075fa None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.626725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5000b-c03d-46f6-b042-c48255b075fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.650116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-05a5000b-c03d-46f6-b042-c48255b075fa None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:48.651659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-05a5000b-c03d-46f6-b042-c48255b075fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:48.660572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 49/98] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:48.707873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50917-344c-4e25-bf6b-83a569e6cfa8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.728692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253fc63-d158-4b51-9ffd-343f858df710 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.729010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253fc63-d158-4b51-9ffd-343f858df710 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.729285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253fc63-d158-4b51-9ffd-343f858df710 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.731298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 50/99] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:48.731820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b50917-344c-4e25-bf6b-83a569e6cfa8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.737161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.738044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.738338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.738616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.746928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.747206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.747492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.759182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:48.766057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:48.767260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 50/100] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:48.770876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:48.772071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:48.775495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.787611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acfca-b580-48ed-bf25-8900d7c0f7ee admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.794644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 51/101] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:48.802603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.803271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.803558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.803834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.804595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:48.804907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.806540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.815700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 51/102] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:48.820813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.833930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6d9b6-c2bb-484d-a668-4c431b685dfc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.842378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.843252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.843540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.843823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.845036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.846900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.848794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 52/103] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:48.854369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.864205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60456b-4fc7-47f5-b074-eb6a1c8dbf1d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.867574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.875598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.876450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.876730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.877005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.878506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c84683-553a-4854-a04c-3d38b4598a40 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.881755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.883809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.884629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.884729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.884922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.885238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.886613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 52/104] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:48.892538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.896203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:48.903981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:48.905183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 53/105] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:48.911592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.913031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8539-56be-4281-b972-033fa5752b2a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.922017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062ae83-79c2-4ba7-83e8-91c8649a69c3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.923514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.924390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.924668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.924942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/27658e4102424ffd80d8ec01579038ea/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.926771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.927408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.927697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.927976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.928728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:48.929038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.930700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.934390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, user_id=27658e4102424ffd80d8ec01579038ea, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.937044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.939607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 54/106] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:48.946103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:48.957518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cc8c-19c0-42ed-a37d-06b1c6fdee0f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:48.963734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:48.964841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:48.965153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:48.965640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:48.967748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:48.969474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 53/107] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:48 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/27658e4102424ffd80d8ec01579038ea/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:57:48.970295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:48.972157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 55/108] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:48.977895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.078213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb22f7d-db48-47bd-a558-2ac39ed62b19 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.087634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.088519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.088800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.089103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.090329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.092456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a0617-ab12-4fef-8332-bc1952a2400d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.094526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 54/109] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:48 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:49.100095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.115565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ee070-9931-44cf-8bfe-70b2869b23ec admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.125390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.126297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.126594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.126876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/55fd3295f7094a86a66e7d75f7c0728a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.128943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, user_id=55fd3295f7094a86a66e7d75f7c0728a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.130000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:49.130000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:49.130000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:49.132291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34078bb-6428-4a17-84bc-03dce752b769 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.175676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 56/110] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:49 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/55fd3295f7094a86a66e7d75f7c0728a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:49.297998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f2c6-5c10-4619-87fa-afe7384f586f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.298328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f2c6-5c10-4619-87fa-afe7384f586f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.298550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15f2c6-5c10-4619-87fa-afe7384f586f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.300671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 55/111] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:49.307730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.308066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.308351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.331834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:49.333049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:49.412008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 57/112] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:49.436365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15f2c6-5c10-4619-87fa-afe7384f586f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.449369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15f2c6-5c10-4619-87fa-afe7384f586f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.454058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.454858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.455196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.455476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.467154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:49.474456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:57:49.475678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 56/113] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:57:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:49.482305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.491776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ff6f3-0055-40c6-99c0-465c4983044d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.496386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.497102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.497375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.497660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.498427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:49.498741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.500352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.509606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 58/114] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:57:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:49.514961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.525538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54576ca6-9afb-4f08-8263-d97241c7a32d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.530063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.531008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.531288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.531564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.532771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.534974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.537120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 57/115] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:49 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:49.543035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.553178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd598a-1055-4d80-bb4b-59c17c7bc98c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.558003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.558906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.559196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.559481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.560827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.562960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e77f1-3bc5-476c-92ea-8afa2f18fdfb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.564924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 59/116] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:49 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:49.570462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.581193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c496c-4ce2-4b46-9276-db01c5603bd6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:49.586591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:49.587503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.587782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.588061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/55fd3295f7094a86a66e7d75f7c0728a/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.590475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, user_id=55fd3295f7094a86a66e7d75f7c0728a, role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:49.593255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a34a3c-99ab-4408-a20e-8c11fb76e9b6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:49.609072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 58/117] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:49 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/55fd3295f7094a86a66e7d75f7c0728a/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:49.860929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237149-d6ff-4691-a714-96f0f56b0c5c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.861642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237149-d6ff-4691-a714-96f0f56b0c5c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.861642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99237149-d6ff-4691-a714-96f0f56b0c5c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.863529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 60/118] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:49.869217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cafb2-50fd-45da-8306-89654242f76e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:49.869692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cafb2-50fd-45da-8306-89654242f76e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:49.869856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cafb2-50fd-45da-8306-89654242f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:49.897933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-968cafb2-50fd-45da-8306-89654242f76e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:49.899687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-968cafb2-50fd-45da-8306-89654242f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:49.961998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 59/119] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:49.985714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99237149-d6ff-4691-a714-96f0f56b0c5c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:49.998794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99237149-d6ff-4691-a714-96f0f56b0c5c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.003527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.004330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.004674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.005008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.018062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:50.025868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-2cb1ab8a-f10d-4c86-b7f0-fa953af3a3a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:50.027364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 61/120] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:50.037369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cafb2-50fd-45da-8306-89654242f76e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.044421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cafb2-50fd-45da-8306-89654242f76e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.056987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.058001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.058483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.058955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.059940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:50.060448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.062483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.062945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc625-06ed-405a-a442-2563ba76a5f0 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.063294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc625-06ed-405a-a442-2563ba76a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.063582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc625-06ed-405a-a442-2563ba76a5f0 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.065779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 62/121] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:50.074379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.074681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.075025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.076841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 60/122] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.086613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.097089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:50.097619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:50.098441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415ddeb-e7ac-4b49-a278-52d340710f8a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.105463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.106347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.106631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.107063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 63/123] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:50.107167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.114364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.116625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.119063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 61/124] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:50.130682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.133979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.144318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b802c8-fedb-4674-820b-96cc769b1663 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.147910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cc72f-4a64-4981-8277-357933a60bb6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.150214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.151275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.151733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.152166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] PATH_INFO: `/v3/projects/68a3884a068d43749f581aabc757e431` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.153555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] RBAC: Authorizing `identity:get_project(project_id=68a3884a068d43749f581aabc757e431)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.155874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.157859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 64/125] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/projects/68a3884a068d43749f581aabc757e431 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.158652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.159455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.159739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.160016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.164903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.185288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d06c9-2d68-449b-9d20-ab6cdc1acf94 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.186123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:50.196068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.198050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.199411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.200819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] PATH_INFO: `/v3/projects/68a3884a068d43749f581aabc757e431/users/55fd3295f7094a86a66e7d75f7c0728a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.205772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a3884a068d43749f581aabc757e431, user_id=55fd3295f7094a86a66e7d75f7c0728a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.206239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:57:50.209801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.209917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 62/126] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:50.220482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.237762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 65/127] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:50 2022] PUT /identity/v3/projects/68a3884a068d43749f581aabc757e431/users/55fd3295f7094a86a66e7d75f7c0728a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:50.241784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464336-2a91-46d9-b181-67536a9dace5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.308374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.309515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.310003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.310453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.311389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:50.311911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.313954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.323596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 63/128] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.329951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.342332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e405d-81d9-47a5-b61d-7f3454c86630 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.347611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.348862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.349376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.349907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] PATH_INFO: `/v3/users/e1c2dd64107e4fd3ac65ebab8efea799` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.366593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] RBAC: Authorizing `identity:get_user(user_id=e1c2dd64107e4fd3ac65ebab8efea799)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.369199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.371322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 66/129] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/users/e1c2dd64107e4fd3ac65ebab8efea799 => generated 289 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.385153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.396395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd78fb-668a-4d0a-86a8-15a0592dd587 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.405258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.406309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.406831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.407282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.416974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.419189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.429869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 64/130] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:50.436756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.450298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db38cf2-8e17-498c-b261-dafd3ace8ab9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.455414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.456617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.457149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.457633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.459258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.462335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ae67c-f380-452f-ae56-f4a230b37a23 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.464371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 67/131] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.470706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.480828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee878aa8-d0a1-4a8e-9b92-13e745233654 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.488077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.489108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.489596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.490132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.491213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=e1c2dd64107e4fd3ac65ebab8efea799) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:50.491716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.494011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334aa98-6413-44c1-bd18-df80936564d2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.500765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 65/132] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/role_assignments?user.id=e1c2dd64107e4fd3ac65ebab8efea799&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.767015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec2b5-9de2-4276-9b4c-827049da2612 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.767607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec2b5-9de2-4276-9b4c-827049da2612 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.768070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ec2b5-9de2-4276-9b4c-827049da2612 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.770350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 68/133] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:50.776631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.777200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.777701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.798782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:50.800289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:50.814935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 66/134] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:50.852609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec2b5-9de2-4276-9b4c-827049da2612 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.866391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ec2b5-9de2-4276-9b4c-827049da2612 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.876840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.877940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.878460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.878939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.880414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.883132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd79cb-90ef-4e22-bd39-b24917819d12 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.885367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 69/135] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:50.891349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:50.901168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8dd46-5538-4122-8a52-9bd5f8ae62f9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:50.906061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:50.906925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:50.907403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:50.907902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:50.908806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:50.911078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc3b53-2b58-470a-863e-1a9b7d13d97c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:50.939790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 67/136] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:57:50 2022] POST /identity/v3/projects => generated 302 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:52.144648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d255d-5025-4caa-ad30-0e06d31219e1 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.145642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d255d-5025-4caa-ad30-0e06d31219e1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.146177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d255d-5025-4caa-ad30-0e06d31219e1 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.148742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 70/137] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:52.154307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.155164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.155659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.179081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:52.180666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:52.240854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 68/138] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:52.268379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d255d-5025-4caa-ad30-0e06d31219e1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.285418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d255d-5025-4caa-ad30-0e06d31219e1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.290169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.291187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.293829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.294374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.305588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:52.312772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-0658c1ba-e048-4ee4-b4bb-c4fe955d151f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:52.318268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 71/139] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:52.324648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.334183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0d13e-2323-40e4-bb46-b29b7d78553e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.338455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd866b-7f71-4bbe-a609-692f55c7b2b2 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.338990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd866b-7f71-4bbe-a609-692f55c7b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.339478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd866b-7f71-4bbe-a609-692f55c7b2b2 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.343075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 72/140] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:52.344478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.345402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.345906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.346408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.347408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:52.349001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.349572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.350053 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.352144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.354089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.374973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 69/141] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:52.380398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.386429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:52.387459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:52.393376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460e8a1-2598-4da6-b377-c2399929b3bc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.398715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.399813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.400302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.400777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] PATH_INFO: `/v3/users/27658e4102424ffd80d8ec01579038ea` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.402207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] RBAC: Authorizing `identity:get_user(user_id=27658e4102424ffd80d8ec01579038ea)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.404609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.406505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 70/142] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/users/27658e4102424ffd80d8ec01579038ea => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:52.408047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 73/143] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:52.413969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.424188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56ebf2-512a-43bf-83a4-8cbeceeb9952 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.433217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.434164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.434664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.435197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.449734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.451120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.452123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.460028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876fc36-f116-463b-a176-56bdb87b37a7 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.462154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 71/144] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:52.470140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.478260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.479056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.479331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.479597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.481349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ac641-a992-4118-a6c6-f805ebdb88aa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.493508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.494721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.495326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.495816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.497329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.499753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.501869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 72/145] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:52.506090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:52.508585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.518721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e0bd7-b3e7-4921-8526-8d896d53e14e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.525114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:52.525114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 74/146] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:57:52.528603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.529506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.530437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.530989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.531467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.532552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=27658e4102424ffd80d8ec01579038ea) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:52.533106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.535397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.546412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 73/147] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/role_assignments?user.id=27658e4102424ffd80d8ec01579038ea&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:52.550679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50230-8674-46f3-9325-7b5c5640a288 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.563125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.563810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.564095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.564371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.565163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:52.565470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.567101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.586723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 75/148] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:52.592660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.603842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f561b39-6153-4181-834c-70b33cac45f2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.614101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.615457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.615958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.616478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.618611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.621088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.622962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 74/149] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:52.628691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.643050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242a35-565c-493d-8f39-7e50202053c4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.655119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.655798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.656082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.656362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.669923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.671706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.685828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 76/150] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:52.691347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.703688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784dea6-5dac-4a02-aff2-e0c7981a2061 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.721917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.723043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.723328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.723603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.724988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.727670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742d3d2-2a2f-495c-b84b-cfb4bbc59bca admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.733161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 75/151] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:52.735842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:52.745958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf3788-3269-43f1-88a9-c1660ab6f72a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:52.761832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:52.762514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:52.762796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:52.763074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:52.763923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:52.764239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:52.766148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10908e-7fad-4455-b65d-33ed19cd70a1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:52.772673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 77/152] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:52 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.383082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48017-fc4d-4e42-9f31-d94be2f6610f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.383556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48017-fc4d-4e42-9f31-d94be2f6610f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.383816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c48017-fc4d-4e42-9f31-d94be2f6610f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.385772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 76/153] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:53.392629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac058458-75e4-438f-9759-94342e56f2df None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.393098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac058458-75e4-438f-9759-94342e56f2df None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.393271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac058458-75e4-438f-9759-94342e56f2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.416284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ac058458-75e4-438f-9759-94342e56f2df None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:53.417491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ac058458-75e4-438f-9759-94342e56f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:53.428276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 78/154] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:53.455120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48017-fc4d-4e42-9f31-d94be2f6610f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.474674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c48017-fc4d-4e42-9f31-d94be2f6610f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.483021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.484149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.484650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.485196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.497484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:53.508254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:57:53.510236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 77/155] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:53.516480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac058458-75e4-438f-9759-94342e56f2df None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.529579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac058458-75e4-438f-9759-94342e56f2df None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.538158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.539379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.539659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.539934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.540690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:53.540993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.542621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccdb45-533b-42f2-8a16-ad1bb07ffdf2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.551402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 79/156] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.557844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.568181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb951d-be1f-4e90-b8a9-703803db5819 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.574531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.575686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.576208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.576722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.578153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.580697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.581963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebb4d-c5d7-4f56-9c27-eb527671a1e9 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.582256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebb4d-c5d7-4f56-9c27-eb527671a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.582531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebb4d-c5d7-4f56-9c27-eb527671a1e9 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.583528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 78/157] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.588012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 80/158] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:53.589042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.589443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.589727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.590003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.600748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8f168-6ece-4642-8f31-9819649a525e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.606407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.607291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.607881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.608373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.608490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:53.609608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:53.617714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 81/159] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:53.619683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.621791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.631641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 79/160] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:53.637869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.642668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.647687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a0d08-1efa-4dfe-a0dc-9f979af90fb1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.652185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.653026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.653344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.653614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.654231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf165cc5-034e-4ae2-9b18-384be158720b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.654937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.657315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.659250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 82/161] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.665390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.666624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.667562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.668285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.669388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.680128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58f0aa-0671-4859-b0b8-4d1484ca40de admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.682300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:53.688336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.689232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:57:53.689474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.689962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.690490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.690693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 80/162] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:57:53.695642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:53.695642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.696393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.697931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.702956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 83/163] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:53.713686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc00373-ee96-47d7-b000-29b34c0f6928 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.718973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.719956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.720406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.720878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.721889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:53.722415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.724310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.736196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 81/164] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:53.742728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.753539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1e2d-d299-4a37-bce8-15b452c5656f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.758895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.760065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.760692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.761143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] PATH_INFO: `/v3/users/55fd3295f7094a86a66e7d75f7c0728a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.762684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] RBAC: Authorizing `identity:get_user(user_id=55fd3295f7094a86a66e7d75f7c0728a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.765162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.767250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 84/165] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/users/55fd3295f7094a86a66e7d75f7c0728a => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.773713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.784856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5dd7-1c3b-4197-bf1e-50b0f39be1fc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.790522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.791456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.791945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.792364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.802105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.804211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.814769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 82/166] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:53.820656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.831218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26769e77-a208-4f37-8177-cd1bb4af3c25 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.836950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.838177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.838636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.839068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] PATH_INFO: `/v3/projects/68a3884a068d43749f581aabc757e431` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.840641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=68a3884a068d43749f581aabc757e431)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.843153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494ae31-b23c-4faa-aa84-c15cf664e1b2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.845200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 85/167] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/projects/68a3884a068d43749f581aabc757e431 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.852182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.862203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5edc-1ebd-4e4a-b09c-4cde8faaa446 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.867335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.868343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.868767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.869232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.870301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=68a3884a068d43749f581aabc757e431, user.id=55fd3295f7094a86a66e7d75f7c0728a) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:53.870759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:53.872987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6443e9-6f3d-4f33-a0bb-cade9bc790b8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:53.880212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 83/168] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/role_assignments?user.id=55fd3295f7094a86a66e7d75f7c0728a&scope.project.id=68a3884a068d43749f581aabc757e431&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:53.886109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731576-0552-4ce8-b8f2-86a845884fee None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.886392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731576-0552-4ce8-b8f2-86a845884fee None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.886664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731576-0552-4ce8-b8f2-86a845884fee None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.890069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 86/169] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:53.894763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.895268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.895725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.916947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:53.918431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:53.926873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 84/170] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:53.949776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731576-0552-4ce8-b8f2-86a845884fee None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:53.964158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731576-0552-4ce8-b8f2-86a845884fee None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:53.968661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:53.969506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:53.969791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:53.970052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:53.982460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:53.989760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:57:53.991136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 87/171] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:53.997387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.007467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630d77-b8f1-4e21-b023-079f995b2474 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.011885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.012526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.012804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.013247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.013870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:54.014174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.015808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.025683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 85/172] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:54.031634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.042895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e6e7-0a06-410a-a5bc-a1e69b75c652 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.047410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.048284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.048569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.048844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] PATH_INFO: `/v3/users/e1c2dd64107e4fd3ac65ebab8efea799` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.050282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] RBAC: Authorizing `identity:get_user(user_id=e1c2dd64107e4fd3ac65ebab8efea799)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.052335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.054327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 88/173] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:54 2022] GET /identity/v3/users/e1c2dd64107e4fd3ac65ebab8efea799 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:54.060726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.070920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf0201f-8498-49a9-9bbb-c7c55b7806f3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.077077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.077511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.078438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.078438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.079423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.081593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154593e-0b7a-46ac-8882-c0fa7ba424a5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.083407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 86/174] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:54 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:54.089844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.099816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acd82d-0fb9-4176-b490-251e865677ab admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.105206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.106217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.106563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.106911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/e1c2dd64107e4fd3ac65ebab8efea799/roles/838e96228d60465f9aa1e2dd3b341ed8` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.109291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, user_id=e1c2dd64107e4fd3ac65ebab8efea799, role_id=838e96228d60465f9aa1e2dd3b341ed8)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.112048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497a3c5-f72e-474e-a245-3cab3287f2df admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.133317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 89/175] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:54 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/users/e1c2dd64107e4fd3ac65ebab8efea799/roles/838e96228d60465f9aa1e2dd3b341ed8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:54.482440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0b997-b3e6-46bd-9184-119d8ca1f306 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.482984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0b997-b3e6-46bd-9184-119d8ca1f306 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.482984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0b997-b3e6-46bd-9184-119d8ca1f306 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.484752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 87/176] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:54.490067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.490507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.490621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.508976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:54.510843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:54.565595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 90/177] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:54.590334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0b997-b3e6-46bd-9184-119d8ca1f306 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.602164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0b997-b3e6-46bd-9184-119d8ca1f306 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.606613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.607381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.607657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.607925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.609073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.610749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a513b19-10a7-464c-a996-1329f3b0b66f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.612313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 88/178] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:54.618054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:54.627585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a42d25-20cb-4799-937f-443b6f2a3780 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:54.632141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:54.633435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:54.633717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:54.633989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:54.634709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:54.635721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:57:54.635721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:57:54.635721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:57:54.636906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa15e5-8684-44b3-81c7-9e99ff7979b8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:54.663940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 91/179] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:57:54 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:57:56.543811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abea-3799-4ce3-8640-90a064035780 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.544324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abea-3799-4ce3-8640-90a064035780 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.544324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7abea-3799-4ce3-8640-90a064035780 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.546269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 89/180] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:56.551700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.552495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.552912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.571444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:56.572827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:56.580636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 92/181] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:56.604597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7abea-3799-4ce3-8640-90a064035780 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.617161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7abea-3799-4ce3-8640-90a064035780 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.621762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.622694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.623111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.623527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.634859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:56.641891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:57:56.643211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 90/182] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:56.651453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.660573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045dbbb6-a7d6-420e-a14c-03918b2a72a6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.665269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.666105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.666526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.666937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.667832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:56.668272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:56.670056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:56.678749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 93/183] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:56.684381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.695577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0b97-1eb6-4336-89a5-5a11f028f6b1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.700559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.701750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.702172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.702583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] PATH_INFO: `/v3/users/e1c2dd64107e4fd3ac65ebab8efea799` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.704065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] RBAC: Authorizing `identity:get_user(user_id=e1c2dd64107e4fd3ac65ebab8efea799)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:56.706443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:56.708818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 91/184] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/users/e1c2dd64107e4fd3ac65ebab8efea799 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:56.715342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.725803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeaaba-9c97-45ed-a9fa-b81c60992f39 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.731152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.731999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.732427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.732838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.741547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:56.744046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:56.753345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 94/185] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:56.759889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.769795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495453-5d3c-453e-ad82-d3844f4bd345 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.774883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.775876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.776315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.776723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.778056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:56.780221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9981cf-c642-4123-86a3-66e1bdd25ec2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:56.782356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 92/186] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:56.788292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:56.797584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50227fe6-2162-4f0a-a056-0390548ebdb1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:56.802213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:56.803023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:56.803442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:56.803869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:56.805454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d, user.id=e1c2dd64107e4fd3ac65ebab8efea799) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:56.805901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:56.807872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e172f-e479-4e1d-9fd3-eb64d9fefa26 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:56.814175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 95/187] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:56 2022] GET /identity/v3/role_assignments?user.id=e1c2dd64107e4fd3ac65ebab8efea799&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.085100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182081-f258-4bea-a38c-f99892f19c92 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.085307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182081-f258-4bea-a38c-f99892f19c92 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.085613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10182081-f258-4bea-a38c-f99892f19c92 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.087555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 93/188] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:57.093083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.093459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.093735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.112628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:57.113811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:57.121919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 96/189] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:57:57.146210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182081-f258-4bea-a38c-f99892f19c92 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.158071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10182081-f258-4bea-a38c-f99892f19c92 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.162209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.162978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.163253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.164034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.173881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:57.181252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:57.182582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 94/190] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:57:57.188036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.197290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ff91e-4f2c-45a0-b7bc-8a9ecb6a6eec None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.201545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.202204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.202483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.202754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.203497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:57.203801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.205393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45be6d-44c2-495d-8dde-092fc1e35c96 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.213691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 97/191] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.218903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.228975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12e7ad-f0e6-4f3c-85a6-5ce48deec883 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.233211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.234057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.234331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.234598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.237490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7584e-fc10-47f0-8eea-e16e9efc3e2b None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.237790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7584e-fc10-47f0-8eea-e16e9efc3e2b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.238066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7584e-fc10-47f0-8eea-e16e9efc3e2b None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.239837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 98/192] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:57.245652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44b9a-10d8-4e32-b535-5c85d4970a13 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.245939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44b9a-10d8-4e32-b535-5c85d4970a13 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.246212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b44b9a-10d8-4e32-b535-5c85d4970a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.249634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.251754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.253690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 95/193] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.258969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.264074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-91b44b9a-10d8-4e32-b535-5c85d4970a13 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:57.265249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-91b44b9a-10d8-4e32-b535-5c85d4970a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:57.268134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b40-70a4-42ec-b918-a5c27769e115 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.272820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.272985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 99/194] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:57.277792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.278075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.278398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.287187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c720-4e50-405d-a75a-0f6ed9123318 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.287318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.287511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c720-4e50-405d-a75a-0f6ed9123318 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.287836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3c720-4e50-405d-a75a-0f6ed9123318 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.289564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.290293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 100/195] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:57.295067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.295351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.295627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.298527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 96/196] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:57:57.302960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.312273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f009d-1ec5-4661-a469-5c5454caaf8d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.313868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:57.315084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:57.316650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.317461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.317747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.318018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.322829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 101/197] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:57.323440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.330374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:57.332052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b5a44-2a2a-459d-a9a5-d4ad58bc3b2e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.336658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.337425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.337650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:57:57.337760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.337957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.338921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 97/198] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:57:57.339099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.341144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.347555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 102/199] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.347677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.347779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.354043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f811cd-6d30-4af3-93f6-7e32a0ad9fcf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.357171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de61c2-9c13-4a34-b84f-400df690a89e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.358366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.358988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.359265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.359539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.360272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:57.360571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.361436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.362168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.362253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.362444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.362715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.363836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.365490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.367635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 103/200] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:57.368354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.371081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 98/201] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:57.372998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.377721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b6fd8-ed6a-43de-816d-70cd64a6121d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.382364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd2181-c3db-4e70-b700-062aa4862cdb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.382478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.383043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.383325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.383600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.384416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=c1dd5e7633c24215b3a860cd999f8531) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:57.384721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.386575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.386686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.387181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.387456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.387724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.388418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.390286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.391962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 104/202] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/role_assignments?user.id=c1dd5e7633c24215b3a860cd999f8531&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.391962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.403598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b13b-d462-4cd0-8c18-36abb3b905d3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.408162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.409045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.409691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.409968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.411300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 99/203] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:57:57 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:57:57.411433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.413507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.416084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 105/204] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.422274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.433271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7defa7f2-ebfc-4c9e-bab1-9d95029b5776 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.438187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.438862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.439137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.439408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.448289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.450202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.460538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 100/205] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:57:57.466175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.476941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264423c2-8ce2-40a2-84d2-b8c825e6f5ee admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.481632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.482528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.482808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.483081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.484422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.486557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfa6e2-7584-41a1-acc8-71cba7de34fa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.488570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 106/206] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:57.495242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:57.504812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28ec88-1992-47ee-8504-f8434d8c3550 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:57.509638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:57.510354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:57.510633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:57.510903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:57.511752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=c1dd5e7633c24215b3a860cd999f8531) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:57.512060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:57.513964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdbbce-a4a5-4816-aefa-9034141e20ff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:57.520473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 101/207] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:57:57 2022] GET /identity/v3/role_assignments?user.id=c1dd5e7633c24215b3a860cd999f8531&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:59.733187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50ce0-71ab-4ebf-b852-9c1ae79ac9ff None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.733719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50ce0-71ab-4ebf-b852-9c1ae79ac9ff None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.733719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50ce0-71ab-4ebf-b852-9c1ae79ac9ff None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.735643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 107/208] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:59.741132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.742497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.742986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.763174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:59.764686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:59.773354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 102/209] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:59.796319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f50ce0-71ab-4ebf-b852-9c1ae79ac9ff None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.811271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f50ce0-71ab-4ebf-b852-9c1ae79ac9ff None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.815907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.816912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.817411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.817874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.828765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:59.836460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-4ea22285-b92e-4aa7-b821-61b998af508f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:57:59.838174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 108/210] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:59.843972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.855495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1eddb9-1cbb-4de8-8757-94f5204ae20d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.855683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656d50-c329-4eb1-a4e1-8e04c90a6235 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.855988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656d50-c329-4eb1-a4e1-8e04c90a6235 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.856277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656d50-c329-4eb1-a4e1-8e04c90a6235 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.858388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 109/211] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:59.861233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.862142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.862617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.863097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.863568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c44c-a968-4378-95f2-6881e7250b3d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.863855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c44c-a968-4378-95f2-6881e7250b3d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.864137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39c44c-a968-4378-95f2-6881e7250b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.864669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:57:59.865195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:59.867128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:59.877739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 103/212] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:59.883766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.886741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ae39c44c-a968-4378-95f2-6881e7250b3d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:59.888283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ae39c44c-a968-4378-95f2-6881e7250b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:59.894665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd14c6-8833-452b-890b-232874829ffb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.896329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 110/213] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:59.900108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.901222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.901698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.902165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.903543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:59.905901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:59.907697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 104/214] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:57:59.911908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6901-37dd-4113-a9d5-a2e07f0942ab None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.911908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6901-37dd-4113-a9d5-a2e07f0942ab None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.911908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6901-37dd-4113-a9d5-a2e07f0942ab None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.912960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 111/215] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:57:59.913269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.919436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.919721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.919998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.927114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024fa7-4553-49f4-a299-7c117bc5f0bd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.931465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.932302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.932578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.932848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.934052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:59.936071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:59.937499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:57:59.941199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 105/216] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:57:59.941199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.941406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:57:59.948424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 112/217] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:57:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:57:59.949452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.950279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242c3ea-e323-4630-bbfb-8d248cd767c0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.954553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.955315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.955592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.955863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.958357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20de6ee-6299-4323-a66a-36789d50670b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:57:59.962990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:57:59.963834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.964110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.964486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/c1dd5e7633c24215b3a860cd999f8531/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.966288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, user_id=c1dd5e7633c24215b3a860cd999f8531, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:57:59.967016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:57:59.968849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:57:59.974268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-ee34117e-7421-4aaa-86b8-44b16fd373be admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:57:59.975461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 106/218] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:57:59.977220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8cd6-5439-45ee-95bd-d25008353d6b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:57:59.977499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8cd6-5439-45ee-95bd-d25008353d6b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:57:59.977768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8cd6-5439-45ee-95bd-d25008353d6b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:57:59.979591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 107/219] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:57:59.980123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8cd6-5439-45ee-95bd-d25008353d6b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:57:59.984293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 113/220] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:57:59 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/c1dd5e7633c24215b3a860cd999f8531/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:57:59.985086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.046556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8cd6-5439-45ee-95bd-d25008353d6b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.049284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ca2f9-c8f3-44fc-8c9f-8a9e391e9bf1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.051047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.051859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.052144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.052410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.054017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.054738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.055022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.055305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.056068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:00.056375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.058029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52fe07-28bb-4e15-920c-9ab3b459d6d3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.063769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:00.067245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 114/221] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.068556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.068844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.073098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.073253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:00.073253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 108/222] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:57:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:00.073253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.087589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e51cd-ef0d-47b8-a7de-de6fa025621a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.094998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.095882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.096165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.096387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:00.096483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.097684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.097790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:00.099857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.102133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 109/223] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.106917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.108278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 115/224] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:00.108968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.116227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668064-c6dd-45b3-8003-a7bad60d1c54 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.118101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74354512-b85c-4676-8bf6-200bd26028fb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.125126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.125126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.125126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.125126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.127982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.128701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.129764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.130163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.130485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.131045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.133101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 116/225] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.133277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:00.133769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.133887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.135486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.144650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d4a04-9c6d-44f3-97db-1c200734f269 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.155285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 110/226] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.155285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.156076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.157111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.157557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.157833 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.159174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.160877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.162746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 117/227] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.163375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.169193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f23250-2f26-4d19-aa67-37454d947ef9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.173918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.174331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796cd8c-7925-4b53-bad9-ecff9fae8d16 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.174821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.175099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.175444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/c1dd5e7633c24215b3a860cd999f8531/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.177716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, user_id=c1dd5e7633c24215b3a860cd999f8531, role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.180610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.180745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.181525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.181810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.182087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] PATH_INFO: `/v3/users/39793928b2de4e1aa0baf266c8285c70` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.198650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 111/228] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:00 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/c1dd5e7633c24215b3a860cd999f8531/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:00.200494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] RBAC: Authorizing `identity:get_user(user_id=39793928b2de4e1aa0baf266c8285c70)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.202768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.204804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 118/229] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/users/39793928b2de4e1aa0baf266c8285c70 => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:00.206139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.211564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.223099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e29f-16d2-4cab-bb28-f9ebf3807415 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.298434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81794b-facf-4b6d-ab47-daf8334ecc96 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.303096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.303777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.304081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.304894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.305421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.306380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.306892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.307340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.308454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.311192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.314267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.316182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.326537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 119/230] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:00.332426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.337394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 112/231] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:00 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:00.343350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900987-a053-4697-ba3d-8b6f6b2b8606 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.351645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.352595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.352878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.353276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.354760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.357112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52290c7f-e754-446a-84b8-2345a88d1475 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.359480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 120/232] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:00.367260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:00.378721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9285e4e-4f64-41bc-afbd-72944c85c38b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:00.384638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:00.385777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:00.386259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:00.386805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:00.387880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=39793928b2de4e1aa0baf266c8285c70) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:00.388461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:00.390788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aca724-8598-4202-b67e-06f54483b780 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:00.397643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 113/233] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:00 2022] GET /identity/v3/role_assignments?user.id=39793928b2de4e1aa0baf266c8285c70&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:02.875639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7d4f-f027-4c1e-87c6-27995d5ae826 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:02.876192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7d4f-f027-4c1e-87c6-27995d5ae826 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:02.876192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f7d4f-f027-4c1e-87c6-27995d5ae826 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:02.878270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 121/234] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:02.884469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:02.884944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:02.885019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:02.910045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:02.911429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:02.927639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 114/235] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:02.970339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:02.970677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c22bd-7224-4122-8b0e-fbb4bcf0ae75 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:02.970967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c22bd-7224-4122-8b0e-fbb4bcf0ae75 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:02.971246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c22bd-7224-4122-8b0e-fbb4bcf0ae75 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:02.973295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 122/236] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:02.980766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281450f-bae5-4f86-8579-158ee97e3325 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:02.985594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:02.985882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:02.986159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:02.988034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:02.988818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:02.989136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:02.989413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.013415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:03.014600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:03.015952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:03.022885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:03.024111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 115/237] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:03.030101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.032210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 123/238] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:03.041690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc663b-7850-4d1c-9714-ba2566956585 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.046093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.046734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.047009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.047280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.048020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.048321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.049916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.057085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.067015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99782b-4f4c-45ac-8a7d-2b3f87484512 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.071196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 116/239] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.074632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.075476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.075752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.077028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.082313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.092050 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86ef84-9c32-4d93-ade9-7b4d52479df8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.099393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:03.106873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:03.107078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.107949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.108230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.108418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 124/240] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:03.108582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.114757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.114757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.114757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 117/241] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.124996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.126288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.143937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38fd92-f0b0-48e9-b3d5-5c44b97c4ab4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.145437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0914e9-847c-491b-b8fd-5725f6652dab admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.152445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.153636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.154283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.154563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.154838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.155590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.155896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.157506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.158850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.159173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.159514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.173867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.175723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.185183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 125/242] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.186595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.186879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 118/243] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:03.197883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.201682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141f9d-72f4-4abe-b364-257b469c99fe admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.206743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb0ff7-913e-4818-ace8-df39d2f10a54 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.215813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.216694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.216980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.217279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] PATH_INFO: `/v3/users/c1dd5e7633c24215b3a860cd999f8531` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.218369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.219201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.219473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.219748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.220901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] RBAC: Authorizing `identity:get_user(user_id=c1dd5e7633c24215b3a860cd999f8531)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.223055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.224674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 126/244] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/users/c1dd5e7633c24215b3a860cd999f8531 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.225378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.227424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.230264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.231195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 119/245] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.235962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.247548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2f0e9-5e53-4830-9ef6-716e77436160 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.250414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bafd-b407-4893-a795-235fee3065b5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.257931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.258638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.258925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.259204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.259816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.260710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.261258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.261792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.262872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=c1dd5e7633c24215b3a860cd999f8531) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.263389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.265681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae987-7627-4b53-995c-8a8939fbae43 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.273372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 120/246] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/role_assignments?user.id=c1dd5e7633c24215b3a860cd999f8531&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.274944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3986-114d-4951-a8ab-08085cac4705 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.275605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3986-114d-4951-a8ab-08085cac4705 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.276084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a3986-114d-4951-a8ab-08085cac4705 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.278188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 121/247] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:03.282563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.285514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a5a5cc-bffd-4a56-8329-8cc67fcaab7a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.295975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313835-5fdd-4ffb-97d9-d6f0dd482842 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.296692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313835-5fdd-4ffb-97d9-d6f0dd482842 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.297220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28313835-5fdd-4ffb-97d9-d6f0dd482842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.311285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 127/248] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:03.313012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b39a-52d8-4592-939b-4e39d71c5b9c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.313568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b39a-52d8-4592-939b-4e39d71c5b9c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.314044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1b39a-52d8-4592-939b-4e39d71c5b9c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.316217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 128/249] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:03.317432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b39a-52d8-4592-939b-4e39d71c5b9c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.324114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-28313835-5fdd-4ffb-97d9-d6f0dd482842 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:03.325513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-28313835-5fdd-4ffb-97d9-d6f0dd482842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:03.336234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 122/250] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:03.337781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.338103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.338381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.340069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1b39a-52d8-4592-939b-4e39d71c5b9c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.344812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.345783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.346110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.346449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.347715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.349853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.351683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 129/251] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.357610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.358775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:03.360309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:03.368740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b066-739a-4602-8342-983a6e6eb8a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.370657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 123/252] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:03.375796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.377394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.380212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.382901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.383405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.384457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=c1dd5e7633c24215b3a860cd999f8531) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.385438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.389785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.401408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 130/253] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/role_assignments?user.id=c1dd5e7633c24215b3a860cd999f8531&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:03.401893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195f94-1dc7-46cf-9ca3-e8e76b5d9a2f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.402959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.412007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.412901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.413305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.413658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.415291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4969ba-56ca-41d2-a722-7b8205538906 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.420669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.421857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.422364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.422815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.435089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:03.436174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:03.443992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:03.446591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 131/254] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:03.451045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:03.452289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.456604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 124/255] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:03.462037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.475624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc3113-adf7-42db-a9d7-bffd1cca706b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.481025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbeca2-4b04-40ec-8866-58f9ba88599a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.486992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.489149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.490149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.491609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.493232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.493720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.495122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.495242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.495690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.496135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.496989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91762945-ec55-4d8c-bd7c-2fe29f02d9a0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.497349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.497834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.500465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3a852-34f8-40d7-a644-40d3fb7c5da8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.507747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 132/256] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.509662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc39e9-8b50-4297-8570-1fb55bc35ae4 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.509962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc39e9-8b50-4297-8570-1fb55bc35ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.510235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc39e9-8b50-4297-8570-1fb55bc35ae4 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.512193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 133/257] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:03.514251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 125/258] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.516929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc39e9-8b50-4297-8570-1fb55bc35ae4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.517631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.518168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.518690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.534094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc39e9-8b50-4297-8570-1fb55bc35ae4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.539864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.540793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.541174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.541457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] PATH_INFO: `/v3/users/39793928b2de4e1aa0baf266c8285c70` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.542708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:03.542822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] RBAC: Authorizing `identity:get_user(user_id=39793928b2de4e1aa0baf266c8285c70)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.543905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:03.544935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.546909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 134/259] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/users/39793928b2de4e1aa0baf266c8285c70 => generated 297 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.547477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.552464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 126/260] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:03.558209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.563437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9317c-f9d1-4cc5-adc5-c63507714c7a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.569111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.570561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.570841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.571109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] PATH_INFO: `/v3/users/3c01696ceb1f4c9fa05156fad8c41869` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.572603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d97068-c592-47b6-b63c-03b5faee980c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.577803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.579156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.579638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.580107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.581981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.584221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.586283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 127/261] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.586998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.587095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c01696ceb1f4c9fa05156fad8c41869)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.593377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.595307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 135/262] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/users/3c01696ceb1f4c9fa05156fad8c41869 => generated 297 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.597414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.598237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cbb2-5087-4c5f-a826-fcf673cfd8f8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.603256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.604123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.604409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.604685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.605933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.607644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.609737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 128/263] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:03.609995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24c4-db57-4440-aac8-fa9a86eb0393 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.610643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.615601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.617308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.617774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.618047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/39793928b2de4e1aa0baf266c8285c70/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.620224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, user_id=39793928b2de4e1aa0baf266c8285c70, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.622766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64992a28-22b8-48a5-a50c-7d60c56c3154 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.622975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.628266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.629020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.629599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.629869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.638739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 136/264] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:03 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/39793928b2de4e1aa0baf266c8285c70/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:58:03.640695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.645152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.645152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.656739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 129/265] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:03.662510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.674071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2219c5-71db-4790-b7d7-848587e1d74b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.732696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2a2e-2050-4c93-8e1f-fb2505d8e899 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.737365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.739886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.739886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.739886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.740973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.743293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.743685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.743986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.744270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.744546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.748885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.749066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 130/266] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:03.749279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826393db-8cce-4dc0-a4f9-3d45f4c80c52 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.752395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:03.764074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063e7ed-4350-4ddf-b984-391b5717dc32 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:03.769493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:03.770580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:03.770998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 137/267] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:03 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:03.771265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:03.771362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:03.772228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=3c01696ceb1f4c9fa05156fad8c41869) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:03.772538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:03.774557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba36f-449b-4546-aeeb-d069cd289149 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:03.780974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 131/268] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:03 2022] GET /identity/v3/role_assignments?user.id=3c01696ceb1f4c9fa05156fad8c41869&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.028734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1a56-6c26-420a-bf48-e0a9ff73e465 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.029281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1a56-6c26-420a-bf48-e0a9ff73e465 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.029281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1a56-6c26-420a-bf48-e0a9ff73e465 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.031210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 138/269] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:06.036282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df7a5a-3348-4a4a-a75e-8712deb4fe71 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.036802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df7a5a-3348-4a4a-a75e-8712deb4fe71 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.036802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df7a5a-3348-4a4a-a75e-8712deb4fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.054997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e3df7a5a-3348-4a4a-a75e-8712deb4fe71 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:06.056150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e3df7a5a-3348-4a4a-a75e-8712deb4fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:06.063929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 132/270] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:06.087387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1a56-6c26-420a-bf48-e0a9ff73e465 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.099610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1a56-6c26-420a-bf48-e0a9ff73e465 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.104009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.104780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.105072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.105415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.115779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:06.121679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074400-2fe4-48f7-926e-347f62138077 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.121973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074400-2fe4-48f7-926e-347f62138077 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.122251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2074400-2fe4-48f7-926e-347f62138077 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.123183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:06.124055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 133/271] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:06.125309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 139/272] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:06.129912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.130091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.130640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.131063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.141780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f1bcf-9dbf-4b9c-9ac5-4e9654b70cf7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.146300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.146945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.147223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.147495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.148258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:06.148563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.150181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.151476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:06.152636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:06.159360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 140/273] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.164275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 134/274] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:06.165326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.174804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76115f-2058-45df-b3f3-1423de2257d8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.183758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.184541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.184819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.185160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] PATH_INFO: `/v3/users/39793928b2de4e1aa0baf266c8285c70` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.186207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.186376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] RBAC: Authorizing `identity:get_user(user_id=39793928b2de4e1aa0baf266c8285c70)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.188499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.190142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 141/275] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/users/39793928b2de4e1aa0baf266c8285c70 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.196145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.196739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333945f2-63ec-4309-a298-1afa619f28bf None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.201293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.202223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.202663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.203106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.206929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd967-00e2-421b-b7db-59174b5b095b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.212173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.212955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.213444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.213884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.214371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:06.222221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-312d96e4-4452-4378-94f2-ad697b7951f4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:06.222461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.223860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 135/276] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:06.224601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418938-7486-45ae-9190-9231a9937806 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.229619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9431ba-6e24-44a5-92fd-f6f7539da426 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.229975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9431ba-6e24-44a5-92fd-f6f7539da426 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.230328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9431ba-6e24-44a5-92fd-f6f7539da426 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.232153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 136/277] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:06.232899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9431ba-6e24-44a5-92fd-f6f7539da426 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.234987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 142/278] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:58:06.238503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.239060 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.239491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.249471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9431ba-6e24-44a5-92fd-f6f7539da426 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.254162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.254899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.255274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.255642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.256480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:06.257623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:06.257726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.258774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:06.259518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696d3b0-0846-40f0-b62d-5c99318a8e95 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.271131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 143/279] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:06.271131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.271330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 137/280] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.273406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9e58-2c39-455f-96be-8c3dab7e4b16 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.273705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9e58-2c39-455f-96be-8c3dab7e4b16 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.273966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d9e58-2c39-455f-96be-8c3dab7e4b16 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.276499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 138/281] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:06.280307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d9e58-2c39-455f-96be-8c3dab7e4b16 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.282128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe19b55-d10f-4852-8136-6fc190c534ef None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.286774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.287721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.288100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.289035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.290313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.292410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456763e-d311-46d6-b453-6b31864d1f13 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.297112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 144/282] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.297235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d9e58-2c39-455f-96be-8c3dab7e4b16 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.297327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.297327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.297327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.300614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.301492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.301772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.302046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] PATH_INFO: `/v3/users/3c01696ceb1f4c9fa05156fad8c41869` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.303219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] RBAC: Authorizing `identity:get_user(user_id=3c01696ceb1f4c9fa05156fad8c41869)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.306031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.307628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 139/283] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/users/3c01696ceb1f4c9fa05156fad8c41869 => generated 297 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.308358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.317439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045efeb-2ea0-46a3-b764-fc9a58c2c8da admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.317759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:06.318933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:06.321684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.322397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.322670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.322935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.326624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 145/284] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:06.328488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.333393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:06.337407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6318-92ad-4a6a-8529-352d699968ef None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.340446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:06.343490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.343617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 140/285] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:06.344218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.345822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.346249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.346709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.347670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=39793928b2de4e1aa0baf266c8285c70) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:06.348120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.350129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.355839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b82d6-10c1-45fe-8710-b0af93d92cd4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.356693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 146/286] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/role_assignments?user.id=39793928b2de4e1aa0baf266c8285c70&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.357344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.360201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.361022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.361336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.361598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.362807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.364850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.367487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 141/287] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.367779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ac39a-22d9-4ba3-9e8f-39e6959979d8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.368859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.372486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.373202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.373482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.373755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.374512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:06.374816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.376453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.380469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b5a9-bbb2-4753-89c7-3eaecbf5108c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.385764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.385913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 147/288] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.386637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.391414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.391699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.391972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.393304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.395040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.396967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 142/289] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.397581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.397757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983367a8-453d-481d-bb45-cb68dfd1e5a1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.407439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a217-f3c8-46a0-a2d4-000eb3630672 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.408449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.409402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.409679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.409948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/3c01696ceb1f4c9fa05156fad8c41869/roles/838e96228d60465f9aa1e2dd3b341ed8` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.411919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.412053 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, user_id=3c01696ceb1f4c9fa05156fad8c41869, role_id=838e96228d60465f9aa1e2dd3b341ed8)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.412779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.413048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.413890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] PATH_INFO: `/v3/users/195ccdd51d14409595e38be49e27a924` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.415205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.432172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=195ccdd51d14409595e38be49e27a924)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.441330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 148/290] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:06 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/users/3c01696ceb1f4c9fa05156fad8c41869/roles/838e96228d60465f9aa1e2dd3b341ed8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:06.441558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.441651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.441727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 143/291] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/users/195ccdd51d14409595e38be49e27a924 => generated 293 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:06.442900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:06.452888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc784a-898f-4825-ac15-c7152a5764f5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.507896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cededc-1502-4ec8-bf57-1d4ae328b05e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:06.512702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.513427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.513707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.513979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.514706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.516813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83a434-2278-4059-9c68-8e716a4320bd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.536640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:06.537423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:06.537951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:06.538079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 149/292] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:06 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:06.541599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:06.542569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, user.id=195ccdd51d14409595e38be49e27a924, scope.system=all) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:06.542882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:06.544931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1e7a3-a015-4e2d-a47b-db7a7b847479 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:06.555192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 144/293] 10.222.0.73 () {56 vars in 1329 bytes} [Mon Feb 21 09:58:06 2022] GET /identity/v3/role_assignments?user.id=195ccdd51d14409595e38be49e27a924&scope.system=all&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 226 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:08.799826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead0c5-6712-4db2-907a-c357a9b40bc9 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.800360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead0c5-6712-4db2-907a-c357a9b40bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.800360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead0c5-6712-4db2-907a-c357a9b40bc9 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.802181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 150/294] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:08.807639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d527-f593-4dd2-ad0b-890de20442c5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.808049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d527-f593-4dd2-ad0b-890de20442c5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.808212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3d527-f593-4dd2-ad0b-890de20442c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.826395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7fa3d527-f593-4dd2-ad0b-890de20442c5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:08.827577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7fa3d527-f593-4dd2-ad0b-890de20442c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:08.835766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 145/295] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:08.859464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ead0c5-6712-4db2-907a-c357a9b40bc9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:08.871710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ead0c5-6712-4db2-907a-c357a9b40bc9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:08.876110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:08.876881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.877188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.877459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.892810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:08.893487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024248-3ab4-46d0-a967-678d038f2a48 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.893990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024248-3ab4-46d0-a967-678d038f2a48 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.894453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7024248-3ab4-46d0-a967-678d038f2a48 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.896413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 146/296] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:08.900546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:08.902083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 151/297] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:08.903626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.903977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.904312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.907672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:08.917806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33078fb-6a00-4825-9a4d-bc415b9b5015 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:08.922420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:08.922958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:08.923202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.923548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.923886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.924700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:08.925091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:08.925258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:08.926913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:08.933212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 147/298] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:08.937082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 152/299] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:08.941969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:08.954043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b8089-60e8-4718-8280-1e1a62f7db8c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:08.958587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:08.958929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:08.960077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.960564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.961025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] PATH_INFO: `/v3/users/3c01696ceb1f4c9fa05156fad8c41869` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.962424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] RBAC: Authorizing `identity:get_user(user_id=3c01696ceb1f4c9fa05156fad8c41869)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:08.964707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:08.966671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 148/300] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:08 2022] GET /identity/v3/users/3c01696ceb1f4c9fa05156fad8c41869 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:08.968772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5821f894-4b05-4653-8668-ec483669c1fd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:08.972407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:08.975110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:08.976471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.976754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.977029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.983489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3423c-e8fa-401e-8d41-64b54d08a917 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:08.988114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:08.988957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:08.989761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:08.990182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:08.990593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:08.995764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:09.001580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 153/301] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:09.002570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.005840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.008077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aa90d-566a-4c04-aa30-b44e20cd0b20 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.013290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d98c-532a-4c55-b7df-1cd3c504f827 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.017790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.018633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.018937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.019216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.019965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:09.024510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.024625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 149/302] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:09.024702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3bf8d-0961-4cdd-a0a6-516fd5c11d6d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.024770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5c7-a53b-4158-b64c-e5e139e0347e None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.024770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5c7-a53b-4158-b64c-e5e139e0347e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.024770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5c7-a53b-4158-b64c-e5e139e0347e None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.026292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 150/303] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:09.027009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe5c7-a53b-4158-b64c-e5e139e0347e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.032622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 154/304] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:09.033947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.034236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.034510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.044593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe5c7-a53b-4158-b64c-e5e139e0347e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.048774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.049716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.050066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.050287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.051723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.052263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:09.053490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:09.054337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.056207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 151/305] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:09.061116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.066221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 155/306] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:09.070612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad386-88e8-4c29-93f8-58d7ade99dd7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.071864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.075116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.076039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.076418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.076789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] PATH_INFO: `/v3/users/195ccdd51d14409595e38be49e27a924` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.078131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=195ccdd51d14409595e38be49e27a924)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.080309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.082121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 152/307] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/users/195ccdd51d14409595e38be49e27a924 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:09.083096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49b734-2bc5-4647-961a-8840d61882e2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.087490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.087822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.088698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.089144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.089554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.090395 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, scope.project.id=cad172f2fef940de8ce35f28a452ada0, user.id=3c01696ceb1f4c9fa05156fad8c41869) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:09.090703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.092523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.098237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83908f79-33a4-49d9-87b2-f114f6b061f5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.098591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 156/308] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/role_assignments?user.id=3c01696ceb1f4c9fa05156fad8c41869&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:09.102105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.103802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.104655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.104931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.105233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] PATH_INFO: `/v3/system/users/195ccdd51d14409595e38be49e27a924/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.106907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=195ccdd51d14409595e38be49e27a924, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.107745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:09.107745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:09.107745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:09.108618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99db9d-d378-4497-9145-812cfd86b1d5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.111902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6df8-e08a-4a37-b0d8-a30ee69e3a91 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.117608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.118458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.118737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.118994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.120320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 153/309] 10.222.0.73 () {58 vars in 1355 bytes} [Mon Feb 21 09:58:09 2022] PUT /identity/v3/system/users/195ccdd51d14409595e38be49e27a924/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:58:09.121603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e132-0db5-4333-8ef4-5422260a7bc2 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.121897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e132-0db5-4333-8ef4-5422260a7bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.122161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32e132-0db5-4333-8ef4-5422260a7bc2 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.126290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 154/310] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:09.133513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.134213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.135090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.142167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:09.150443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:09.152695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 157/311] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:09.158063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.159453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:09.160980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:09.169765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce8e72-dc7d-4d7c-9c79-f2a79cdd94d4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.172757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 155/312] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:09.175440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.176394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.176874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.177364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.178305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:09.178908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.180739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.192024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 158/313] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:09.198701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.199387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.208816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3337e43-84d5-4c5b-9686-b7f9c4675f9d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.212991 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f16af-737a-48be-8ef7-676255e9ddbe admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.214201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.215150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.215411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.215780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.217153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.218982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.219424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.220515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.220941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 156/314] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:09.221243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.221683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] PATH_INFO: `/v3/users/3d77ddb8d50647cfad50271bcadee8f1` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.227564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.237975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14802-95cd-4312-af16-010cb0cb7506 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.241340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] RBAC: Authorizing `identity:get_user(user_id=3d77ddb8d50647cfad50271bcadee8f1)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.242985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.243728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.244111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.244452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] PATH_INFO: `/v3/groups` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.244948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.245377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.246491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:09.246491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:09.246491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:09.252566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f7ab-6f38-4ce3-a9f0-038eb8c1eca1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.252988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 159/315] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/users/3d77ddb8d50647cfad50271bcadee8f1 => generated 293 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:09.254513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:09.267730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ccab-d536-42fa-95a7-9d79150972ea admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:09.273465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:09.274546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:09.275049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:09.275529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:09.276625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, user.id=3d77ddb8d50647cfad50271bcadee8f1, scope.system=all) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:09.277285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 157/316] 10.222.0.73 () {60 vars in 1155 bytes} [Mon Feb 21 09:58:09 2022] POST /identity/v3/groups => generated 229 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:09.277528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:09.279790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356e529-7b59-4e58-b10b-8158d43f5106 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:09.297271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 160/317] 10.222.0.73 () {56 vars in 1329 bytes} [Mon Feb 21 09:58:09 2022] GET /identity/v3/role_assignments?user.id=3d77ddb8d50647cfad50271bcadee8f1&scope.system=all&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:11.451076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74454b2-8cc5-4cc1-90fd-1c5d48d92c07 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.451561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74454b2-8cc5-4cc1-90fd-1c5d48d92c07 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.451561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74454b2-8cc5-4cc1-90fd-1c5d48d92c07 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.453630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 158/318] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:11.458591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.459025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.459167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.477005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:11.478191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:11.485732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 161/319] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:11.510055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74454b2-8cc5-4cc1-90fd-1c5d48d92c07 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.521926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74454b2-8cc5-4cc1-90fd-1c5d48d92c07 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.526106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.526869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.527142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.527406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.537412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:11.544128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:11.545461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 159/320] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:11.550850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.560140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea723f4-8ead-48ee-94f1-cc4aff6249ad None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.564402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.565048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.565364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.565635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.566378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:11.566680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.568251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55088942-182f-4f39-ad69-f1b1803bc2e3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.577203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 162/321] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:11.582331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.593046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f12b89-5559-4948-94ab-b0816e7fccce admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.597254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.598107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.598380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.598647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] PATH_INFO: `/v3/users/195ccdd51d14409595e38be49e27a924` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.599815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=195ccdd51d14409595e38be49e27a924)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.603101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.603658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890919-5bb7-4655-8f73-e9ba525259e7 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.603945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890919-5bb7-4655-8f73-e9ba525259e7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.604219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890919-5bb7-4655-8f73-e9ba525259e7 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.604833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 160/322] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/users/195ccdd51d14409595e38be49e27a924 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:11.606118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 163/323] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:11.610309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.611215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b29c0e-6945-4fb7-8d82-99e63d48f17a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.611492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b29c0e-6945-4fb7-8d82-99e63d48f17a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.611761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b29c0e-6945-4fb7-8d82-99e63d48f17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.619821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb7925-6ef5-4389-9cb6-09e7b5fdb1b1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.623983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.624596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.624871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.625172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.625980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] RBAC: Adding query filter params (role.id=ae4ae0d888b948acbe5f5a7a262b2e20, user.id=195ccdd51d14409595e38be49e27a924, scope.system=all) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:11.626281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.628074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.630235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a1b29c0e-6945-4fb7-8d82-99e63d48f17a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:11.631580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1b29c0e-6945-4fb7-8d82-99e63d48f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:11.639743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 164/324] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:11.641007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740b8-8557-4194-8a57-98a57fafe923 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.641320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740b8-8557-4194-8a57-98a57fafe923 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.641591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6740b8-8557-4194-8a57-98a57fafe923 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.643353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 165/325] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:11.647948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 161/326] 10.222.0.73 () {56 vars in 1329 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/role_assignments?user.id=195ccdd51d14409595e38be49e27a924&scope.system=all&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:11.648493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.648772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.649044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.666234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.668379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:11.669666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:11.676306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8003a0-49d9-45a0-9695-b0e08bfb00b8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.681413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.682221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.682495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.682760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.685277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 166/327] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:11.695460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:11.702637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:11.704035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.704231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 162/328] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:11.710624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.714421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b9c8b-50d5-47da-9c26-f7a641edb3f1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.718964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.719767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.720109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.720387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.720539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6a172-c387-4ce9-b238-74f08db09df8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.721603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.723347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.725202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.725327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 167/329] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:11.725766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.726047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.726385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.727152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:11.727460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.729139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.730680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.738781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 163/330] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:11.740397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58f3b4-0e28-4486-938a-e434488fff2e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.744575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.745479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.746124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.746404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.746677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] PATH_INFO: `/v3/groups` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.747378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.748392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:11.748392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:11.748392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:11.749592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.754567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc1ec9-efbe-486f-8c7a-9a86bf12a917 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.761596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.762926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.763208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.763489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] PATH_INFO: `/v3/users/3d77ddb8d50647cfad50271bcadee8f1` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.764718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d77ddb8d50647cfad50271bcadee8f1)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.766931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4784723-b22d-4a61-88b6-3274919f4a35 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.767865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 168/331] 10.222.0.73 () {60 vars in 1155 bytes} [Mon Feb 21 09:58:11 2022] POST /identity/v3/groups => generated 226 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:58:11.768745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 164/332] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:11 2022] GET /identity/v3/users/3d77ddb8d50647cfad50271bcadee8f1 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:11.774760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:11.785360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f3dc-eb0f-49c0-81c5-f50a0ee09acc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:11.790802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:11.791685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:11.791965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:11.792239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] PATH_INFO: `/v3/system/users/3d77ddb8d50647cfad50271bcadee8f1/roles/838e96228d60465f9aa1e2dd3b341ed8` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:11.793898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d77ddb8d50647cfad50271bcadee8f1, role_id=838e96228d60465f9aa1e2dd3b341ed8)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:11.794941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:11.794941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:11.794941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:11.795850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd62d5-db70-4cac-ba79-b64710c6ae8f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:11.805959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 169/333] 10.222.0.73 () {58 vars in 1355 bytes} [Mon Feb 21 09:58:11 2022] PUT /identity/v3/system/users/3d77ddb8d50647cfad50271bcadee8f1/roles/838e96228d60465f9aa1e2dd3b341ed8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:15.056621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8514-5abf-4adf-b2fe-57a0adf44fac None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.057153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8514-5abf-4adf-b2fe-57a0adf44fac None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.057230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8514-5abf-4adf-b2fe-57a0adf44fac None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.058966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 165/334] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:15.078998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.079524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.079524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.113980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:15.115471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:15.134692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d0b2-f7b5-4b48-ac84-846b8d3e4a52 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.134984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d0b2-f7b5-4b48-ac84-846b8d3e4a52 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.135248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334d0b2-f7b5-4b48-ac84-846b8d3e4a52 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.137293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 166/335] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:15.139166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 170/336] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:15.152804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.153106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.153384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.166764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.175844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d64c-8415-4c7d-8c8b-989ca90cccae None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.180407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.181276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.181562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.181839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.200555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:15.201786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:15.217157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:15.224123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:15.230307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 167/337] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:15.230719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 171/338] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:15.238722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.254114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901112f7-7965-49e4-9201-42cc6c0985a8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.259071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.259749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.260029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.260303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.261092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.261409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.263039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc58e-b855-43a1-a18b-7633dd49dd07 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.278189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 168/339] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.283976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.295660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4896d-9f7c-474f-b34c-aeabc33ab55c None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.295961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4896d-9f7c-474f-b34c-aeabc33ab55c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.296210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4896d-9f7c-474f-b34c-aeabc33ab55c None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.298045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 169/340] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:15.301727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215b7df-4b14-4ffb-99c1-bb4c93828dc2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.306588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.307382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.308628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.308907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.309203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.310781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.311058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.339770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.341587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.351184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:15.352328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:15.357640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 172/341] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:15.358678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.364686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 170/342] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:15.369695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.379451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca32c2-a2f9-4743-91fb-ab3712fbd98b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.385219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679f775-7339-4525-bbf4-e7c929ae1ff9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.391856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.392663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.392945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.393251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.396050 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.398025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.398316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.398591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.402947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.405011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.407318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 171/343] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.408697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.423943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:15.434472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b487e8-c28b-4594-bde4-2d5be689978e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.437567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:15.438804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 173/344] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:15.439575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.448387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.449197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.449478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.449782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.459666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb93c92-c6cc-47eb-845a-313a760b6210 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.468221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:15.475171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 21 09:58:15.478228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.479079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.479359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.479634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.481617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 172/345] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:15.482409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.493149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.493521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d66f9-32a9-43ec-b319-97d4dd46cc4f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.494780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:15.494780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:15.494780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:15.496298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.499218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 174/346] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.500280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.504506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.505203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.505484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.505757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.506518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.507122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.510886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938bbb2-efc1-4479-a021-e6be48864db9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.518190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa32501-e5a1-412c-8919-20dcd574eb1b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.518704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 173/347] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.520574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa427-e5e5-44d7-b052-77f75c074afd None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.520574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa427-e5e5-44d7-b052-77f75c074afd None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.520838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaa427-e5e5-44d7-b052-77f75c074afd None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.524899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 174/348] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:15.524899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa427-e5e5-44d7-b052-77f75c074afd None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.529621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.530288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.530563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.530832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.531578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.531881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.533492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.540061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaa427-e5e5-44d7-b052-77f75c074afd None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.544489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.545155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.545439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.545715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.546446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 175/349] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.546553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=cad172f2fef940de8ce35f28a452ada0) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.546833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.547372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.548775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e809498-576b-49df-82bd-d7ad2aa72280 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.554823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 175/350] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.556033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.556316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.556587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.574423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-c7bd-4dd9-a94b-f2932e49afb7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.576816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:15.578062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:15.586647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.587416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.587799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.588074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.589470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 176/351] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:15.590328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.599824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.603517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea933f3-e64d-4170-b9bf-6693afeb4923 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.610133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.620354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 176/352] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:15.622980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.623891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.624172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.624447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] PATH_INFO: `/v3/users/3d77ddb8d50647cfad50271bcadee8f1` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.625889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] RBAC: Authorizing `identity:get_user(user_id=3d77ddb8d50647cfad50271bcadee8f1)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.627470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.628309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.630289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 177/353] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/users/3d77ddb8d50647cfad50271bcadee8f1 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.636309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.642107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310daf7-4697-4b19-90bf-050571f102c6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.649818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adafbdc6-b21d-47ba-bac6-cfd352826bfc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.650342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.651419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.651707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.651980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.653369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.654637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.655399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.655512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.655854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.656227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.657211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] RBAC: Adding query filter params (role.id=838e96228d60465f9aa1e2dd3b341ed8, user.id=3d77ddb8d50647cfad50271bcadee8f1, scope.system=all) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.657602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 177/354] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:15.657709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.658700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.659913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.670780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34e8cb-0553-4b28-a829-b04dfd5aacc9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.673981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 178/355] 10.222.0.73 () {56 vars in 1329 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/role_assignments?user.id=3d77ddb8d50647cfad50271bcadee8f1&scope.system=all&role.id=838e96228d60465f9aa1e2dd3b341ed8 => generated 510 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:15.675022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.685830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cfc11-7182-4a1c-8618-1eaac36674a0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.686981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.687910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.688182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.688455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.691293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.692402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.692835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.693280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.695276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.696473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:15.696473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:15.696473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:15.697984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.700238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 179/356] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.707063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.713773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:15.728072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fa2a4-734d-4302-b0cf-151fafeac600 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.728433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:15.729946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 178/357] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:15.736966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.749340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f536-c6e9-489c-8d23-bcaa03f0e1d9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.753026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.753026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.753026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.753026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.753427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.753663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.756525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197199-830d-4313-b0fe-e0584cf1f540 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.758441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.759366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.760045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.760478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.761430 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:15.761904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.764301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc3cb-7c29-4b66-9ffb-917b6d4a930c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.767965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 180/358] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 260 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:15.769841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a7e8-d611-4a11-ad91-4b320c630f48 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.770125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a7e8-d611-4a11-ad91-4b320c630f48 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.770393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a7e8-d611-4a11-ad91-4b320c630f48 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.775937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 181/359] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:15.776211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 179/360] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.783346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a7e8-d611-4a11-ad91-4b320c630f48 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.788201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746465c-561f-499d-a391-896dc159f84e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.788535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746465c-561f-499d-a391-896dc159f84e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.788763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746465c-561f-499d-a391-896dc159f84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.817256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a7e8-d611-4a11-ad91-4b320c630f48 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.826332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.826914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.827192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.827463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.829101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d746465c-561f-499d-a391-896dc159f84e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:15.830362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d746465c-561f-499d-a391-896dc159f84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:15.843101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.844918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.854190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 180/361] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:15.858052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 182/362] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:15.866618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746465c-561f-499d-a391-896dc159f84e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.883398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746465c-561f-499d-a391-896dc159f84e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.893689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.895002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.895535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.896007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.902115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.904766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.907040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 181/363] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.913251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.918297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.922990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fa39f-6ecc-42be-b0be-54e7971c2e9a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.935327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d5228-ac4a-4670-aced-762080560464 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.938652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.940842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.943659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.945462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.947441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:15.949936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.952457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:15.952969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:15.953478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:15.953780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:15.963227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 183/364] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:15.968003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:15.983905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27a113-d7c3-4c09-9884-8ed7533c53fd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:15.986535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:15.998788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:15.999964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.000446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.000908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.002028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:16.002569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.003686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:16.006022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 182/365] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:16.008356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.017866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.026585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 184/366] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:15 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 260 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.035214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f835692-0c3f-4fa5-8aac-68928b2d7331 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.042540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.044129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.044664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.045158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.046207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:16.046712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.048718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.062326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 183/367] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:16.068529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.081648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a6d6-baa1-4e9f-9071-afd68740b7df admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.098956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.100106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.100622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.101186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.112296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.114488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.133890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 185/368] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:16.140081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.159528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b97eb-05ab-45db-8f89-5b825cc9f100 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.170853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.171733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.172010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.172287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.177972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.180616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.182835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 184/369] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.188325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.200279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a737540-2694-444a-a332-16e1e5df53fd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.206545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.207889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.208425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.208900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.211699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.214246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbcad-0e8a-4292-8475-ffc3639af661 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.219045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 186/370] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.222432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.238935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a361f6-4626-49e7-8775-661894625290 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.249555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.250225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.250508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.250783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.251624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=cad172f2fef940de8ce35f28a452ada0) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:16.251933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.253814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae87db-cf8a-4cbd-8d60-75549198b9d3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.264326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 185/371] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.620070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4f0b-7183-429e-bc45-4bba5232abcd None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.620432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4f0b-7183-429e-bc45-4bba5232abcd None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.620628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff4f0b-7183-429e-bc45-4bba5232abcd None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.622738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 187/372] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:16.627654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.627942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.628223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.654061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:16.655267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:16.666034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 186/373] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:16.688687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4f0b-7183-429e-bc45-4bba5232abcd None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.706681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff4f0b-7183-429e-bc45-4bba5232abcd None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.717743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.718541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.718825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.719100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.733502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:16.740359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:16.741926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 188/374] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:16.747311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.756561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfc26e-f773-483e-b584-c4bec6d90c0a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.768065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.768803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.769110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.769392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.770148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:16.770457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.772049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.785238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 187/375] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.791761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.806034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09597bb4-4c10-443d-b7c0-b523dca66f5b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.813210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.813889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.814166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.814434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.832761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.834534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.851718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 189/376] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:16.857384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.870541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b712a20-689b-426a-973b-a795002b24b4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.876816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.877692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.877974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.878249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] PATH_INFO: `/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.879448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0eb1e05c525c48b0a68ad872b0aea42a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.881240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.883218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 188/377] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a => generated 344 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.888960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.898632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4377124-8523-4731-a75b-8b66cb2597a4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.904985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.905854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.906137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.906406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] PATH_INFO: `/v3/groups/4c4fbaa9443249138bc6a9a440da5393` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.915729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] RBAC: Authorizing `identity:get_group(group_id=4c4fbaa9443249138bc6a9a440da5393)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.917720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898e3d6-fd82-421f-8a12-e7384aa40397 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.919690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 190/378] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/groups/4c4fbaa9443249138bc6a9a440da5393 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:16.925706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:16.937986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f64012-3c42-40b8-b060-8917bf61e0d4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:16.948642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:16.949304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:16.949587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:16.949863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:16.950721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] RBAC: Adding query filter params (group.id=4c4fbaa9443249138bc6a9a440da5393, role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=0eb1e05c525c48b0a68ad872b0aea42a) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:16.951004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:16.952825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5452c-c94a-4483-9dfd-8c6f8ae7ea51 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:16.961656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 189/379] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:16 2022] GET /identity/v3/role_assignments?group.id=4c4fbaa9443249138bc6a9a440da5393&scope.project.id=0eb1e05c525c48b0a68ad872b0aea42a&role.id=408af600f9f04514bc0631f4887e6d97 => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:18.544552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fec2b-f8f6-44a8-900b-f4ea095652b4 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.545122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fec2b-f8f6-44a8-900b-f4ea095652b4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.545122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fec2b-f8f6-44a8-900b-f4ea095652b4 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.546918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 191/380] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:18.552367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b452ca-068c-4dda-8d89-6ad5ad24c94b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.552777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b452ca-068c-4dda-8d89-6ad5ad24c94b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.552945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b452ca-068c-4dda-8d89-6ad5ad24c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.578109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-47b452ca-068c-4dda-8d89-6ad5ad24c94b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:18.579304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-47b452ca-068c-4dda-8d89-6ad5ad24c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:18.593305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 190/381] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:18.628758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fec2b-f8f6-44a8-900b-f4ea095652b4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.646646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fec2b-f8f6-44a8-900b-f4ea095652b4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.651210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.652009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.652288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.652561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.662249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f78b3-e04f-41c8-9fd3-d66f961ba01c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.662545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f78b3-e04f-41c8-9fd3-d66f961ba01c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.663369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f78b3-e04f-41c8-9fd3-d66f961ba01c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.665500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 191/382] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:18.666032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:18.677074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:18.679153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 192/383] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:18.681822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.682108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.682381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.687892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.698394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c894363e-2c84-4940-b9f8-0e2e21572f8f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.702929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.703578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.703851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.704118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.704858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:18.705186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.706768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.714578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:18.715519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 193/384] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:18.715768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:18.726294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.730261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 192/385] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:18.743036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d132a6-b5fd-4542-883d-7ec969b9b7aa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.747724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.748753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.749224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.749689 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.751003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.753094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.755132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 194/386] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:18.761220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.774963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a7312-3cc7-40f3-98ec-3a65deed0fc2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.776790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.780483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.781369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.781648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.781923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.785798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.787886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.788586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86fd0-678c-4798-a386-6f6ce88d741f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.789903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 193/387] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:18.793463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.794463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.794972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.795414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.795576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.805233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b5c2-b8b6-4873-86d0-641c35b40128 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.807269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:18.814614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:18.816448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 195/388] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:18.822999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.823237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.824167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.824452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.824728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/groups/919022c39bd54946b580b8e9863cd33a/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.831808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, group_id=919022c39bd54946b580b8e9863cd33a, role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.835424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b399-25fa-4dbc-bc55-b9f86535ac2e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.835600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.840167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.841044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.841534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.841970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.842880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:18.843349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.845139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.855030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 196/389] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:18.860814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.872201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2ef97-7a7e-44bc-90a5-310b383277ca admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.874703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 194/390] 10.222.0.73 () {58 vars in 1463 bytes} [Mon Feb 21 09:58:18 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/groups/919022c39bd54946b580b8e9863cd33a/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:58:18.936731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.937662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.937976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.938256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.939460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.941464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.943070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 197/391] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:18.949561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:18.966583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4511529-1020-4ea0-8c23-42b9fc036f78 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:18.979240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:18.980124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:18.980407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:18.980685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:18.982770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:18.984846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe175d1-73b6-4a21-bebd-410397890f61 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:18.987109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 195/392] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:18 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:18.993388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.007801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf48acd-3986-4d93-b92f-18f5d67aa810 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.015493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.016443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.016727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.017002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/groups/919022c39bd54946b580b8e9863cd33a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.022798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, group_id=919022c39bd54946b580b8e9863cd33a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.025620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb24091-a646-4356-84bb-de19a2934b88 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.057995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 198/393] 10.222.0.73 () {58 vars in 1463 bytes} [Mon Feb 21 09:58:18 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/groups/919022c39bd54946b580b8e9863cd33a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:19.378113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fb02-d006-4766-98e9-9b853d636b63 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.378407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fb02-d006-4766-98e9-9b853d636b63 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.378596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1fb02-d006-4766-98e9-9b853d636b63 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.380439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 196/394] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:19.386198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.386486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.386759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.407655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:19.408822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:19.473746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 199/395] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:19.503683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fb02-d006-4766-98e9-9b853d636b63 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.518265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1fb02-d006-4766-98e9-9b853d636b63 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.522854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.523689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.523972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.524418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.538435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:19.545925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:19.548319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 197/396] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:19.556119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.565887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddda02c-9e19-4ab7-841c-84409c31328b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.570387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.571043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.571317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.571640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.572394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:19.572741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.574400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.583264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 200/397] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.589191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.599746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a3449-dde3-4b59-8ca4-433d901dba8e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.604909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.605846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.606124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.606453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.607672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.609645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.611688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 198/398] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.617274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.629835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df87807-6a9f-4a3f-976c-6b634659c203 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.634819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.635849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.636175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.636496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.638367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.640558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee2605-0478-49a7-9ac0-0cfe6666fff4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.642372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 201/399] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.648699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.659004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7119bf0-4c52-4c25-9b0f-82a214c4cf83 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.664481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.665422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.665754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.666029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/groups/919022c39bd54946b580b8e9863cd33a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.670386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d99cbb0d0ac454e8e908bc974cfb43d, group_id=919022c39bd54946b580b8e9863cd33a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.673191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.688807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acd45-d184-4f0a-be69-bd1635ce98d6 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.688807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acd45-d184-4f0a-be69-bd1635ce98d6 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.688807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677acd45-d184-4f0a-be69-bd1635ce98d6 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.690575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 202/400] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:19.696992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.697765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.698244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.703910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 199/401] 10.222.0.73 () {58 vars in 1463 bytes} [Mon Feb 21 09:58:19 2022] PUT /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d/groups/919022c39bd54946b580b8e9863cd33a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:19.719713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:19.721400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:19.785805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 203/402] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:19.810680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.821850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b33e79-f514-43ef-b6cb-ee769ab05964 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.826872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.828058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.828540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.829007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.842130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:19.850043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:19.852407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 200/403] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:19.858477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.868897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec0ad5-7611-4f83-aeac-a68ae505a7fc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.873780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.874827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.875329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.875788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.876752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:19.877272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.879131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.891848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 204/404] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.897844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.911036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7084-45d0-4a9d-9ec0-22c0252504d4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.917168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.918089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.918364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.918690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.919999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.922069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.926909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 201/405] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.930514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.946950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1015d9-669e-499d-afa0-fe00b0466490 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.951493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.952414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.952781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.953107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.954698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.956780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dfce9b-eee3-4927-91fb-237b3f052eba admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:19.958833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 205/406] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:19 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:19.964494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:19.974962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0c047-b0da-4aa0-9356-cf71e67fd576 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:19.982069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:19.983190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:19.983640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:19.984143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0/groups/919022c39bd54946b580b8e9863cd33a/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:19.986619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad172f2fef940de8ce35f28a452ada0, group_id=919022c39bd54946b580b8e9863cd33a, role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:19.989562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b18de-8eb4-4b25-9457-64f35919c9cf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:20.010449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 202/407] 10.222.0.73 () {58 vars in 1463 bytes} [Mon Feb 21 09:58:19 2022] PUT /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0/groups/919022c39bd54946b580b8e9863cd33a/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:20.285145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf242-58b3-4986-811c-c620c87cbb77 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.285499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf242-58b3-4986-811c-c620c87cbb77 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.285694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bf242-58b3-4986-811c-c620c87cbb77 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.287693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 206/408] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:20.293091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.293673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.294165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.317242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:20.318753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:20.386811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 203/409] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:20.425763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf242-58b3-4986-811c-c620c87cbb77 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:20.443680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bf242-58b3-4986-811c-c620c87cbb77 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:20.450203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:20.450987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.451322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.451592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.466477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:20.477874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:20.479473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 207/410] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:20.485385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:20.496613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a98ef6-c384-48e1-95b3-1a3a21d18299 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:20.503877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:20.504820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.505338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.505806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.507331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:20.507826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:20.509608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:20.524860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 204/411] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:20.530202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:20.541141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3597fbe-5e48-4e30-be6c-c4f064c259b6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:20.553895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:20.554763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.555040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.555308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] PATH_INFO: `/v3/groups/4c4fbaa9443249138bc6a9a440da5393` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.561802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] RBAC: Authorizing `identity:get_group(group_id=4c4fbaa9443249138bc6a9a440da5393)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:20.563718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:20.565686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 208/412] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:20 2022] GET /identity/v3/groups/4c4fbaa9443249138bc6a9a440da5393 => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:20.571744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:20.586140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc793-f123-4646-a891-133e20a363e6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:20.596300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:20.597850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.598325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.598800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] PATH_INFO: `/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.605787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] RBAC: Authorizing `identity:get_project(project_id=0eb1e05c525c48b0a68ad872b0aea42a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:20.607802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad959205-5abb-4010-bfe6-5ac4e451cc78 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:20.610072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 205/413] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:20 2022] GET /identity/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:20.615373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:20.625851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a9faa-7d54-4407-b0a0-fc0452bc9676 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:20.637142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:20.638016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:20.638300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:20.638576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] PATH_INFO: `/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a/groups/4c4fbaa9443249138bc6a9a440da5393/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:20.646342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb1e05c525c48b0a68ad872b0aea42a, group_id=4c4fbaa9443249138bc6a9a440da5393, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:20.648989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350434d-6e80-4650-a02a-9bf86ec72f74 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:20.670608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 209/414] 10.222.0.73 () {58 vars in 1463 bytes} [Mon Feb 21 09:58:20 2022] PUT /identity/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a/groups/4c4fbaa9443249138bc6a9a440da5393/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:21.797155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38a2de-100c-4b98-9b43-3e59c2b5d93e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:21.797762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38a2de-100c-4b98-9b43-3e59c2b5d93e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:21.797762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38a2de-100c-4b98-9b43-3e59c2b5d93e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:21.799726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 206/415] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:21.805221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:21.805648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:21.805821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:21.830120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:21.831310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:21.895747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 210/416] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:21.936255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38a2de-100c-4b98-9b43-3e59c2b5d93e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:21.958780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38a2de-100c-4b98-9b43-3e59c2b5d93e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:21.969697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:21.970522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:21.970804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:21.971079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:21.984658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:21.992485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:21.994015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 207/417] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:21.999755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.014087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ae3d7-55c6-4a7a-aed5-27371d13a37b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.022965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.023631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.023908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.024180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.024928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:22.025252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.026862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.044621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 211/418] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.049872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.066116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c2f8-b38a-457b-b5c5-463d52e4a54d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.076394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.077045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.077351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.077624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.093429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.095628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.106964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 208/419] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:22.112456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.125822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da60c4-678c-46fc-a2af-f03f4c6048b6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.133523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.134435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.134709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.134976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.137009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.139114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.141173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 212/420] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.146300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.162181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd35e-29da-4f8a-a4ba-b345f000e15a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.173253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.174109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.174393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.174666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.181792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.183694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a039a-5c10-43b3-9fc9-8c7428553241 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.185354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 209/421] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.191832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.210820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4da2d1-924b-43f1-a7f8-b302a54f7c31 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.218459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.219156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.219438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.219711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.220638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:22.220997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.222903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a2f5a-2317-4662-8f83-4fe2f73696e9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.234213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 213/422] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 611 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.382159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e266e9-6d11-438b-968a-934fac3a389d None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.382461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e266e9-6d11-438b-968a-934fac3a389d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.382627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e266e9-6d11-438b-968a-934fac3a389d None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.384700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 210/423] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:22.390056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.390360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.390610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.416812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:22.418037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:22.433884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 214/424] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:22.474486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e266e9-6d11-438b-968a-934fac3a389d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.488057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e266e9-6d11-438b-968a-934fac3a389d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.499307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.500044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.500326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.500597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.517802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:22.525424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:22.526954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 211/425] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:22.532493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.541673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c548b3-4cb7-4e2b-a115-4d087ed58975 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.549281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.549953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.550234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.550509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.551268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:22.551572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.553200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.568288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 215/426] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.574104 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.590442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbf9f4-77d0-4c57-9f4d-7818716736e3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.602518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.603181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.603463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.603739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.618244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.620011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.635997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 212/427] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:22.641301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.655106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a2f57-0448-4915-8190-5654310c5767 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.659649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.660494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.660769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.661038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.662604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.664672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.666371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 216/428] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.672016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.682734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39083a3f-7872-4895-a02f-9af52d5fc55f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.687826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.688670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.688948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.689249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.690450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.692342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a43ae-8e47-427f-9db9-bfb1522d9c6e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.694846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 213/429] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.701394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.714267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108c79d-6af5-462d-86f5-bfbf553ed6ee admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.721809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.722556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.722835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.723116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.724006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=cad172f2fef940de8ce35f28a452ada0) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:22.724314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.726328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67fe71-c9e3-45e5-94ba-35d1a1a2ba26 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.735988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 217/430] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.739669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea242-81a1-4324-bf30-7be9e3ebce22 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.739958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea242-81a1-4324-bf30-7be9e3ebce22 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.740236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea242-81a1-4324-bf30-7be9e3ebce22 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.742958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 214/431] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:22.748545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.748827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.749129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.770592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:22.771871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:22.783079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 218/432] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:22.810953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea242-81a1-4324-bf30-7be9e3ebce22 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.827192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea242-81a1-4324-bf30-7be9e3ebce22 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.831803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.832627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.832910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.833234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.849828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:22.857548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:22.859118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 215/433] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:22.865177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.879474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b38baf-017b-4459-bfda-7f37e008180a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.887338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.888291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.888765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.889252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.890188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:22.890668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.892477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.906378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 219/434] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.911628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.921964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ebc1-ad90-445f-8cd6-5f0e485cefc7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.930657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.931331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.931617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.931892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.944855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.946646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.958878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 216/435] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:22.964733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:22.978170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbc43a-53e7-49c8-9cf6-ef9d0e529d98 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:22.985412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:22.986293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:22.986572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:22.986847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] PATH_INFO: `/v3/projects/cad172f2fef940de8ce35f28a452ada0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:22.988133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] RBAC: Authorizing `identity:get_project(project_id=cad172f2fef940de8ce35f28a452ada0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:22.990362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:22.993042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 220/436] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/projects/cad172f2fef940de8ce35f28a452ada0 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:22.998607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.010473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81723d-5188-4c84-a2f7-1e2e50b4c7bb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.015108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.015950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.016234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.016507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.017726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.019609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68568-dbcf-42bc-8d60-03943ba175e3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.021571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 217/437] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:22 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.027374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.038155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f06-6331-47b1-98ee-9ec9b4174a2c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.043222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.044162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.044642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.045171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.046257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=cad172f2fef940de8ce35f28a452ada0) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:23.046821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.048928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1ae22-220c-446c-91ec-9b97722c6974 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.056650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 221/438] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=cad172f2fef940de8ce35f28a452ada0&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.355438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1c6af-a937-4cc2-b6ef-ce89a886d801 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.355720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1c6af-a937-4cc2-b6ef-ce89a886d801 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.355994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1c6af-a937-4cc2-b6ef-ce89a886d801 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.357832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 218/439] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:23.363038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.363328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.363602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.382446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:23.383667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:23.391325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 222/440] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:23.415299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1c6af-a937-4cc2-b6ef-ce89a886d801 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.427415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1c6af-a937-4cc2-b6ef-ce89a886d801 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.432020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.432784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.433071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.433347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.443076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:23.450518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 21 09:58:23.451661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 219/441] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:23.457377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.466165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539b9d8-ec63-491a-acdc-d61d65817936 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.470465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.471107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.471382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.471650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.472386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:23.472684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.474281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.482286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 223/442] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.487511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.497430 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68462ef1-e884-4d97-8667-512b4d0431e9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.501652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.502312 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.502550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.502820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.511503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.513243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.521765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 220/443] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 09:58:23.527016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.536237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b49883-3909-472a-91aa-51c197317c17 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.540571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.541425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.541705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.541978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] PATH_INFO: `/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.543146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d99cbb0d0ac454e8e908bc974cfb43d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.545176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.546823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 224/444] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/projects/4d99cbb0d0ac454e8e908bc974cfb43d => generated 298 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.551694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.560830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e2be1-74fd-425c-88d0-c694a2281c5d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.565242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.566046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.566319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.566583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] PATH_INFO: `/v3/groups/919022c39bd54946b580b8e9863cd33a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.567728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] RBAC: Authorizing `identity:get_group(group_id=919022c39bd54946b580b8e9863cd33a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.570125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b601aae-1c35-47dd-98c3-cfb96be00d04 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.571648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 221/445] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/groups/919022c39bd54946b580b8e9863cd33a => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:23.577229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.586516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaa15-b38f-4f66-904c-22001106b422 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.590716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.591328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.591601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.591867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.592766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] RBAC: Adding query filter params (group.id=919022c39bd54946b580b8e9863cd33a, role.id=ae4ae0d888b948acbe5f5a7a262b2e20, scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:23.593084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.594874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540969a2-c861-451e-88e4-6f21572ede3c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.600710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 225/446] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/role_assignments?group.id=919022c39bd54946b580b8e9863cd33a&scope.project.id=4d99cbb0d0ac454e8e908bc974cfb43d&role.id=ae4ae0d888b948acbe5f5a7a262b2e20 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.739406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd82d6-b237-4af0-bf61-296960989d3e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.739608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd82d6-b237-4af0-bf61-296960989d3e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.739863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd82d6-b237-4af0-bf61-296960989d3e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.742180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 222/447] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:23.747871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.748157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.748436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.767117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:23.768403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:23.775954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 226/448] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:23.799622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd82d6-b237-4af0-bf61-296960989d3e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.812621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd82d6-b237-4af0-bf61-296960989d3e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.817161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.817911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.818194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.818469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.828879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:23.835793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:23.836972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 223/449] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:23.842654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.852381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae400ae2-ba41-444b-b35a-3f00369a7221 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.856741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.857452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.857723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.857990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.858734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:23.859030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.860583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.869763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 227/450] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.875406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.885332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f4220-9d6b-4060-afcf-57128eecf487 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.889697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.890324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.890605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.890880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.899126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.900845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.909557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 224/451] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:23.915549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.925258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8535008-e8bd-4537-946d-34a4cd2f4ba1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.931098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.931941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.932216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.932485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] PATH_INFO: `/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.933684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0eb1e05c525c48b0a68ad872b0aea42a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.935444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.937112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 228/452] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/projects/0eb1e05c525c48b0a68ad872b0aea42a => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.942412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.951292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12479bbb-1b2b-41e0-86c5-e9cc88462583 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.957876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.958712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.958985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.959251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] PATH_INFO: `/v3/groups/4c4fbaa9443249138bc6a9a440da5393` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.960421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] RBAC: Authorizing `identity:get_group(group_id=4c4fbaa9443249138bc6a9a440da5393)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.962309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc660f-d475-4036-b4bf-eb58afe447b3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.963873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 225/453] 10.222.0.73 () {56 vars in 1201 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/groups/4c4fbaa9443249138bc6a9a440da5393 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:23.969677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:23.979906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639c8d-8eba-4b04-bed9-7f17ea8523c1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:23.984317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:23.984944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:23.985253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:23.985522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:23.986337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] RBAC: Adding query filter params (group.id=4c4fbaa9443249138bc6a9a440da5393, role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=0eb1e05c525c48b0a68ad872b0aea42a) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:23.986677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:23.988426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad2ce9-bd93-4e0e-a6ed-1b4c6f37d803 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:23.995181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 229/454] 10.222.0.73 () {56 vars in 1397 bytes} [Mon Feb 21 09:58:23 2022] GET /identity/v3/role_assignments?group.id=4c4fbaa9443249138bc6a9a440da5393&scope.project.id=0eb1e05c525c48b0a68ad872b0aea42a&role.id=408af600f9f04514bc0631f4887e6d97 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:26.907687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6382-0feb-4640-865c-9b3a00dd981d None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:26.908233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6382-0feb-4640-865c-9b3a00dd981d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:26.908233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b6382-0feb-4640-865c-9b3a00dd981d None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:26.910317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 226/455] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:26.917321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:26.917762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:26.917936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:26.940933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:26.942138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:26.956164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 230/456] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:26.996410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b6382-0feb-4640-865c-9b3a00dd981d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.010150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b6382-0feb-4640-865c-9b3a00dd981d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.017034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.017837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.018119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.018390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.029185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.030998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.051527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:27.053640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 227/457] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:27.059191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.068294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682d246-7d9c-4b53-9933-a9ba1422ecc4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.086276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.086953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.087236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.087508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.088240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:27.088546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.091497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead38532-e44f-44c8-b883-3384518787a2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.108937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 231/458] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:27.114265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.130020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c8ac8-797d-46d7-a51e-49950ee2540a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.142530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.143192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.143472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.143745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.144531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.146462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d9cf-37b3-4ee2-aa45-235e8850c6c4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.187513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 228/459] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/users => generated 246 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:27.219970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6dc0-0090-41f3-be82-b792234d87a0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.220298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6dc0-0090-41f3-be82-b792234d87a0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.220529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6dc0-0090-41f3-be82-b792234d87a0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.222918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 232/460] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:27.228869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.229181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.229456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.257689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:27.258897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:27.271653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 229/461] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:27.308575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6dc0-0090-41f3-be82-b792234d87a0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.330832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6dc0-0090-41f3-be82-b792234d87a0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.338790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.339599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.339879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.340153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.352354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.354267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.384234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:27.385874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 233/462] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:27.391146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.404740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b5f80-bc18-4ecb-9ff2-507d1effaa08 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.418775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.419450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.419726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.419998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.420729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:27.421027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.422059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:27.422059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:27.422059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:27.422926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d72ba-70f9-4b79-bc14-206cfa0de180 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.454503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 230/463] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:27.460173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.474950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d171-420f-4b28-b5d0-d9c8771095e6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.485105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.485790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.486069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.486338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.487148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.489063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e48d6-d310-4f32-83ca-697faeb0e0c9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.523358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 234/464] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:27.598400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4813-9918-4e64-afd7-31e36336d840 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.598716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4813-9918-4e64-afd7-31e36336d840 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.598938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4813-9918-4e64-afd7-31e36336d840 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.601624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 231/465] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:27.607481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.607771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.608031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.629576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:27.630798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:27.643953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 235/466] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:27.676721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4813-9918-4e64-afd7-31e36336d840 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.695044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4813-9918-4e64-afd7-31e36336d840 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.699713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.700857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.701172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.701472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.718348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.720180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.744105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:27.745339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 232/467] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:27.751274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.762439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d5ab-902f-4138-ae55-daf405e0fa9c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.769520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.770175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.770452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.770723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.771453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:27.771778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.773939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227c62d-8f4f-4e08-8892-cea1a2e9961c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.790545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 236/468] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:27.791892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.801891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a9dd9-49e1-4c4e-8d61-ab9f3303d673 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.806392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.807050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.807331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.807606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.808323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.810267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6aa00-bed0-40d1-af5d-2f7728cf27d7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.840048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 233/469] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/users => generated 248 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:27.842705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86dd3e-487a-4524-8233-8c02d83cd7a6 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.842989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86dd3e-487a-4524-8233-8c02d83cd7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.843264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86dd3e-487a-4524-8233-8c02d83cd7a6 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.845509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 237/470] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:27.853525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.853869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.854195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.875154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:27.876455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:27.891002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 234/471] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:27.914756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86dd3e-487a-4524-8233-8c02d83cd7a6 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.930838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86dd3e-487a-4524-8233-8c02d83cd7a6 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.935768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.936651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.937080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.937367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.950388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.952277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:27.972307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:27.975457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 238/472] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:27.980283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:27.990165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a676f10-f54e-4185-bce6-5b600083921a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:27.995877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:27.996552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:27.996832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:27.997126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:27.997866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:27.998167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:27.999967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf24cd2-1815-4bca-826c-70fb474b4bc0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:28.017211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 235/473] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:28.019400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:28.030491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f18e-85fb-4537-8926-2380986712c7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:28.035290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:28.035963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.036241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.036570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.037937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:28.039914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f7be0-f4b7-478a-a911-8c68686eef63 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:28.065258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 239/474] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:28 2022] POST /identity/v3/users => generated 249 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:28.299308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f4177-f69b-4556-950e-bf77f6cf8a11 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.299801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f4177-f69b-4556-950e-bf77f6cf8a11 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.300227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f4177-f69b-4556-950e-bf77f6cf8a11 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.302436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 236/475] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:28.308433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.308725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.309004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.329135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:28.330626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:28.340413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 240/476] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:28.364268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f4177-f69b-4556-950e-bf77f6cf8a11 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:28.380179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f4177-f69b-4556-950e-bf77f6cf8a11 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:28.386131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:28.386787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.387064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.387334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.388081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:28.389696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:28.404523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.sql.core [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 21 09:58:28.404523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 21 09:58:28.404523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [parameters: {'id': 'af81e6e9657240c0b11a83536051a542', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 21 09:58:28.404523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79432) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:58:28.419163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 21 09:58:28.420530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 237/477] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 09:58:28 2022] POST /identity/v3/roles => generated 144 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:28.426284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:28.435652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e8cf-1127-45cc-878b-d4e34955f228 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:28.440395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:28.441230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.441506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.441772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.453279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:28.461255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-26d91745-865d-4690-ac87-c6899c95bd78 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 21 09:58:28.462873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 241/478] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:28.468084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:28.484454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80d0c0-e322-44b1-a228-bed73867a57f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:28.490229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:28.491145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:28.491567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:28.491975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:28.492858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:28.493328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:28.495119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dcc151-ba43-4e54-a0be-c2d0c8bddb9e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:28.509151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 238/479] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.216524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e2c95-e658-4078-aea8-ee3d80de002b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.217473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e2c95-e658-4078-aea8-ee3d80de002b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.217760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e2c95-e658-4078-aea8-ee3d80de002b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.219894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 242/480] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:30.234753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.235743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.236212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.255660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:30.261731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:30.269725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 239/481] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:30.293222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e2c95-e658-4078-aea8-ee3d80de002b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.309909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e2c95-e658-4078-aea8-ee3d80de002b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.321231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.322335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.322810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.323278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.345685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:30.353204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:30.355129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 243/482] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.361324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.371335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b303b-d4f9-4137-b541-ab3033a13d84 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.381888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.382568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.382842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.383108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.383858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.384157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.385832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.401487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 240/483] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.407151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.422198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5e9a3-c65b-479c-bd15-bdc2d31a9004 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.433077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.434115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.434602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.435090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.455088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.457368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.480233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:30.481763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 244/484] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.487458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.502666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93488db6-448a-4af5-9161-389c1d251d2a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.508196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.508880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.513333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.513699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.514499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.514809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.516476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895e4be-273e-4030-9c00-0d84dfd1d294 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.540887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 241/485] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.546569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.562117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076e11-26f4-4b0b-9cea-6b2606c7cb30 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.573149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.574280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.574758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.575223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.594555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.597037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.602584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb79d6-fd40-4389-9ed3-ce50efe446fd None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.602863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb79d6-fd40-4389-9ed3-ce50efe446fd None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.603383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb79d6-fd40-4389-9ed3-ce50efe446fd None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.605658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 242/486] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:30.616856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:30.621878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 245/487] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.622949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.623433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.623895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.627283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.637516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf9af9-cda5-43e8-a4ee-45e1756413eb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.649625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:30.650811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:30.653473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.654129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.654405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.654675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.655511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.655808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.656811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:30.656811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:30.656811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:30.657933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.693382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 243/488] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:30.712897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 246/489] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.718427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.730278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9dcc2-f12f-4231-9cc9-615b257cfa98 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.734840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.735484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.735768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.736042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.742875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.752809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28008a08-196a-4ed5-8001-3fdf2bc4cf59 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.757285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.759658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.765946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.766909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.767336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.767746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.777983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 244/490] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:30.784192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.794145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd232e6f-63fa-486a-9355-a3a78bb1d1e9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.796026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:30.798910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.799857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.800294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.800708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.802918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:30.804408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 247/491] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.810198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.817074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.820577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.823201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65bb91-12d1-4db3-be54-e2019df14b4e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.836035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.836921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.837380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.837803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.838690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.839133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.840855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.853037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:30.858927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 245/492] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.861364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 248/493] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.866216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.869996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.877110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba84a86-2762-43ef-b9fb-d98604b747a0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.882285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.883170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.883637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.884093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.885012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.885531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.887510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee5f3-7356-42eb-ad01-d1f946301387 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.888124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d3b58-5705-4fae-be24-ece3b37badb6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.898384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.899164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.899601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.900016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.901862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 246/494] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:30.903345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f83a-2e28-4003-81b3-fae70fb259c1 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.903841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f83a-2e28-4003-81b3-fae70fb259c1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.904302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17f83a-2e28-4003-81b3-fae70fb259c1 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.906664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 247/495] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:30.907543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17f83a-2e28-4003-81b3-fae70fb259c1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.915768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.917691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.926850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17f83a-2e28-4003-81b3-fae70fb259c1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.932660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.934180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.934972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.935517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.937252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-81095ca8-4260-4cec-935c-b90b2d808099 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:30.939250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 249/496] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.940481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.945083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.945778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.947040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.949396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.965407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:30.965808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:30.966821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 248/497] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:30.967425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:30.968217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.977768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 250/498] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:30.985294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271676ff-9803-4e50-874e-5e2813478bda admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:30.985419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:30.988931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:30.989713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:30.989987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:30.990256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:30.992802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:30.992802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:30.993450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:30.996262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aca39-4ecd-4106-bb3b-edb9a31ade59 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.005862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 249/499] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.007472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.011344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.012056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.012382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.012657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.013521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.014069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.015299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:31.015299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:31.015299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:31.016766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.017477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d6aef-b63a-4484-9586-b415977db56a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.022234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.023065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.023345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.023616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.033886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:31.041747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 251/500] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.041747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.041923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a0bc0e6d-9baa-4828-9dcc-b0f3b7ab7d85 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:31.042180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 250/501] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.046331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e519-0740-49a3-a4b9-3b191c4f6e56 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.046331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e519-0740-49a3-a4b9-3b191c4f6e56 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.046331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18e519-0740-49a3-a4b9-3b191c4f6e56 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.046331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 251/502] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:31.049892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e519-0740-49a3-a4b9-3b191c4f6e56 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.051465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9537d-3d20-439f-b81b-51713a0293a3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.056330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.057126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.057406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.057674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.063626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18e519-0740-49a3-a4b9-3b191c4f6e56 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.065193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.067200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.068179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.069385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.069667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.069937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.070761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.071070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.072877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.085931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 252/503] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.085931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.086173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-00a3c1fe-379f-43e2-8848-4c8b4b224289 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:58:31.086173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 252/504] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.086173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.086173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.086173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.100351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e98b18-9ab9-4e8b-97b0-f951d518826e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.109975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.111175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.111854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.111962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:31.112429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.113189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:31.113774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.114393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.117081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.123525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 253/505] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:31.124674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.136038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 253/506] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.138099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.146040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2073ea-d248-4ad2-900a-704f6b0cd75c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.159134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734752cf-2c81-4061-91d3-5668d67899e9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.161333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.162009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.162331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.162603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.163444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.163743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.165625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.173524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.175023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.175517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.176169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.191625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 254/507] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.191625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.196751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.199166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.206527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754fe02a-72ee-4a6f-b57a-a6746aa1c715 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.212234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.212882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.213324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.213742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.223340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.229102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:31.230031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 254/508] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.231173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.233134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:31.239276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 255/509] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.239276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.246897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0073d-0c81-432d-8de4-2a614ef5070f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.253007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.253858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.254577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.254984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.258018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79705e-4acf-48bd-9926-a41d24c1a6d6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.265417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.266371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.267310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.267627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.267977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.268496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.270215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.271122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.273776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.285998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 255/510] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:31.285998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.293943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1455a8b-3eeb-479e-8826-fbe7304b15c6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.295339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 256/511] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.300574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.300693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.301403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.301810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.302229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.303598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.303926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.305994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.310931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344abb36-14ff-432c-8c84-73c19ffba349 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.318198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 256/512] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.319376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.319511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.319766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.320859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.320859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.331655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeed-7bcc-4920-a2ed-6837bccd68b1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.336551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.337366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.337696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.337935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.339140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.342088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.346094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.348190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.362140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.362510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:58:31.363707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 257/513] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.364147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 257/514] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.364464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.372821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.377435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7fdb-9257-45f5-b27d-217a8603fb64 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.383710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fde32-fc94-49e0-8512-65774858c7ac admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.385005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.386255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.386698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.387322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.388901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.389580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.389858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.390218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.390837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.391136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.392722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.402307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.404533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.404659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 258/515] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.408993 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.418427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cd0a3-7919-473b-8ad4-eee454f087df admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.423032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.423702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.423975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.424245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.425086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.425415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.427216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.432689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.434398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 258/516] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.435740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.446125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 259/517] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.446831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.448142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdd29d-1723-4868-ac23-30985e867ec0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.453361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.454033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.455330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.455606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.458399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa76-76e7-48f2-8818-b42e140f2410 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.463149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.463837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.464113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.464382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.465230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.465533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.466314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.467162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.468860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.479959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 260/518] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.480840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.485941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:31.488001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 259/519] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.489244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.491946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ba-0c3f-45a9-96e9-3a72f54a73ee admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.496834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.497700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.498070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.498466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.501389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b926fb-28bf-49f3-b013-d03a4de78614 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.507217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.507706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.508339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.508850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.509306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.510081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.518477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.519828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 261/520] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:31.520845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.520972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.530433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581f22b-decf-4540-a354-c9a8633e5d64 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.535127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.535879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.536251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.536614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.538388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.539012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.539241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:58:31.540861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 260/521] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.541790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.541903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.554252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2204bac-3a74-424c-a45c-6ec5014ab7cc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.555666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 262/522] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.556646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.559329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.560249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.560670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.561100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.567006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a072e6-1589-475f-baf4-ee08c4eac80a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.572302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.573226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.573600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.573963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.574325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.575013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.575446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.576622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.577598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.596645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.597453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 263/523] 10.222.0.73 () {56 vars in 1160 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.598211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 261/524] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.598615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.606070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.614180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c025395f-88b3-4713-9617-41f82e6c2065 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.616029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd7cdf-33cf-4c97-aea0-2cb92e709da2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.620074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.620479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.621122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.621367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.621467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.621665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.622074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.622763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.623766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=9e0131ca364c4f3c98aa0f49f6013a94) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.624240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.626233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.630743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.632699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 264/525] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/role_assignments?user.id=9e0131ca364c4f3c98aa0f49f6013a94&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.633680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.637480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.654407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc517723-b3b5-4f36-a6a6-34a4f0862fd3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.656411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 262/526] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:31.661808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.662392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.663862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.664307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.664745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.665728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.666200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.667962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65aab7-81b5-4b79-980b-09e77c5968c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.678773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3065-bb5e-4016-bac0-27e48ae2c9e4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.687865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 265/527] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.688830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.689860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.690316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.690786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.693115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c1f2-52ab-45fc-827c-b27148ba9d86 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.693654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c1f2-52ab-45fc-827c-b27148ba9d86 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.694094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c1f2-52ab-45fc-827c-b27148ba9d86 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.696353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 266/528] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:31.697390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c1f2-52ab-45fc-827c-b27148ba9d86 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.708425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.711276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.716924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c1f2-52ab-45fc-827c-b27148ba9d86 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.722952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.724052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.724335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.724609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.732713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-c0675fde-ae70-41c6-b9e7-5f4bd0011153 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.733085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.734870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 263/529] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:31.734974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.737235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.737735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.738070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.751970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:31.754191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 267/530] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.755276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.757879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:31.759577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:31.766988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcf1e8-3ec8-4994-9cb7-e402f7897017 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.768307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 264/531] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:31.773187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.782810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.783660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.783939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.784210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.785901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.786271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.788951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.792699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f08c8-98b3-4407-9f8f-c3d907135237 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.803471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.804606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.805123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.805575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.806648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.807138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.807567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 268/532] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.808503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.809078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:31.809078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:31.809078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:31.810578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.818951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb201c-ef86-4310-a227-c2e4f0ccf4ab admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.824494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.825425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.825779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.826126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.832777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 265/533] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.833998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.840641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.843273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.846026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a9337-b505-4118-a213-3b7dbf9c31bd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.851706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.852751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.853215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.853630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.861044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.863209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.863989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:31.865938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 269/534] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.866455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.877286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891def-6b0c-4191-ad17-3e8aed0a4c40 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.878793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:31.880133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 266/535] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:31.881308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.882307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.883014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.883364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.883708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.884611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=731b9e74f74e4b4898bb81851831be5e) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.884993 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.886894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.893818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 270/536] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/role_assignments?user.id=731b9e74f74e4b4898bb81851831be5e&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.894554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0282abb-1f46-4af2-941f-eed03db7b639 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.894674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.900176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.901232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.901658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.902075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.902968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.903423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.906299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.917087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedd60d-1bf5-42b0-a22c-56a0af3b3e22 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.923983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 267/537] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.931447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.933830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.935172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.937318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.938648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.939666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:31.940852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.944868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.954641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93faab-c5b2-4ca0-a8ad-b0cdc1487a24 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:31.964265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:31.967311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:31.967826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:31.968266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:31.969971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:31.974013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 271/538] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:31.975635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bc964-163a-4bb2-aba3-9c17c7205e0b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:31.981080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:31.999524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 268/539] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:31 2022] POST /identity/v3/users => generated 247 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:32.009229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78d044-1e6e-457e-aaae-830657ee4f8f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:32.020323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:32.021086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:32.021363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:32.022222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:32.023172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7ce1c786c9fd4009aba04bccafdd01e7) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:32.023534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:32.025618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d542779-6fae-42a8-83c8-24429e900c5f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:32.041125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 272/540] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:31 2022] GET /identity/v3/role_assignments?user.id=7ce1c786c9fd4009aba04bccafdd01e7&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:33.701661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551ad3-0c6f-4392-a51d-c4c2025cd7ab None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.702698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551ad3-0c6f-4392-a51d-c4c2025cd7ab None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.703246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5551ad3-0c6f-4392-a51d-c4c2025cd7ab None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.705270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 269/541] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:33.710646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.711469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.711939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.734367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:33.736071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:33.746704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 273/542] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:33.790315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551ad3-0c6f-4392-a51d-c4c2025cd7ab None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:33.803691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5551ad3-0c6f-4392-a51d-c4c2025cd7ab None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:33.812563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:33.813699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.814213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.814682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.829890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:33.837145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:33.838555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 270/543] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:33.844487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:33.854394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f18df-c294-4583-911b-66b248613bd6 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:33.865210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:33.866809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.867323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.867802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.868783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:33.869331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:33.871180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:33.881141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 274/544] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:33.887314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:33.899214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46930b-581f-4ca6-ad9b-8601348edb30 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:33.912764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:33.913954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.914451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.914921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.926323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:33.928464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:33.954217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:33.955729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 271/545] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:33.962018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:33.972016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918f1f-c734-48e8-aeb3-0e9f9bf0f205 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:33.981082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:33.981970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:33.982465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:33.982931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:33.983848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:33.984346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:33.986130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.004370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 275/546] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.010065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.020243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e215b9-54f5-4b03-9226-92e114abaabf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.032648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.033707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.034208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.034674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.043539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.045849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.066959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:34.068506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 272/547] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:34.074333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.090115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2a7e0-abb6-437f-a213-5b2d9b19b973 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.105741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.106431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.106721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.106999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.107849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.108160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.110024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.133150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 276/548] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.138394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.149641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d11d93-1294-4e81-89e8-4de161288d86 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.165919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.167130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.167614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.168114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.179801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.181987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.211129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-48078bfe-fdcd-4d00-b4ce-650150333015 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:34.212681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 273/549] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:34.218435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.234739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acaca55-35ef-4747-8be6-8b9921020bb4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.245245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.245923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.246205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.246482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.247219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.247526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.249183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.252161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e918e-af23-43a2-b278-772dd432526e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.252444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e918e-af23-43a2-b278-772dd432526e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.252725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e918e-af23-43a2-b278-772dd432526e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.255068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 274/550] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:34.260531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.260842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.261124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.263179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 277/551] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.268542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.291229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1dcc-eefa-4d59-95f0-535c94533e1a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.294008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:34.295204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:34.301734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.302525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.302824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.303953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.315510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 275/552] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:34.322072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.324200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.342411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:34.343894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 278/553] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.349289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.358993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651896-aeab-4295-bb46-2fa277fbfd5e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.369208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.369858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.370137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.370411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.371196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.371498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.373326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.379131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.390887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53aec06-711d-4be3-873e-309fe1907c20 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.395231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 276/554] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.395771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.397201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.397485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.397754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.401435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.409201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:34.416640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b48e-50ab-49e1-ae4d-bbeb025a98a9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.417107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:34.418587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 279/555] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.424096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.431814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.432712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.432993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.433397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.434388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6263406-f887-48d5-bb87-ce30fa979303 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.450028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.450680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.450951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.451216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.451951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.452253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.453846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.468384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=3f538116ef3047e092d7680577ac75f1, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.470936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045c388-f108-4f88-a086-24840275a655 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.475707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 280/556] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:34.481671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.498134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 277/557] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:34 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:58:34.499791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52aaf-dd57-4f15-92ed-56632fdc954c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.564081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.564883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.565839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.567128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.578877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.580753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.591057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7127b-5032-4c21-98b8-99248423ce62 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.591341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7127b-5032-4c21-98b8-99248423ce62 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.591612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7127b-5032-4c21-98b8-99248423ce62 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.594017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 278/558] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:34.602898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.603179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.603458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.604227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:34.605934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 281/559] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.613766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.628958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:34.630200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:34.630765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f622e8-3a7a-4d66-8294-2ccfc7f55df6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.639176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 279/560] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:34.640005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.640834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.641282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.641738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.642717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.643175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.644949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.666362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.667600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 282/561] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.673104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.676052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2234aec-1f4a-4778-8f03-acba5695915f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.687322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.688731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.689015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.690234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.691276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97427e-8df3-4eea-b0ac-80c6b0b61bc1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.702463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.703258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.703532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.704089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.715345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:34.720664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.722840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.723164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:34.725262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 280/562] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:34.731893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.745188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:58:34.745451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b81e89-5eb1-44db-ac2f-5de3fd16f1d2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.747535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 283/563] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.753422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.762890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.763836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.763836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.764117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.764879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.765215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.766816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.770057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1393d76-590c-4890-a3f3-32d0537a00d8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.780985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 281/564] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:34.782754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.783812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.784219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.784595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.785892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.786259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.786669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.789474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.800665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfec92-ad27-4f86-93dc-1cc8586285e0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.815430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 284/565] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.819854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.819854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.819854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.819854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.821244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.830302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.830996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65231674-78e8-4d78-9876-d4b2e3c0b3c7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.837001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.844059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.844838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.845135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.845411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.862435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:34.865221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 282/566] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.869392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.876203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.878378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.879563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201506f5-ad7d-44a2-96e5-a0bacde0de7e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.884641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.885377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.885660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.885987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.886751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.887108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.888751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.906702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 283/567] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:34.915985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.918900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:34.926979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 285/568] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:34.929473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fafa5-c530-4171-a57f-a4b7c1eceae9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.930887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:34.942008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.942809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.943303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.943577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.947734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f66334-ab27-48c8-8a4c-eeaa0c171c98 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:34.956107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:34.958004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:34.958293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:34.958566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:34.959989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:34.960288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.962670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:34.964683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.965556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:34.988120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:58:34.989252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 284/569] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:34.991656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 286/570] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:34.997147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.002151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.018510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd17a2d-f02e-4924-be38-7572115d2405 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.018965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8ed3f-f6fa-41dd-b8f0-d62fdadc6540 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.027630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.029018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.029367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.030285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.030699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.031123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.031528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.031957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.033476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.034124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.038777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be11782-2018-4093-9797-87b4eabc63ea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.047515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.049717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.069666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:35.077099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 287/571] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.077099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de336-94d0-4b23-bd32-e562e7e49126 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.077099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de336-94d0-4b23-bd32-e562e7e49126 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.077099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de336-94d0-4b23-bd32-e562e7e49126 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.078066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 285/572] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.079050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.079316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 288/573] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:35.080831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.081149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.081429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.098557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9080c6-19db-4372-a235-943506e58b49 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.100604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:35.101849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:35.103786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.104688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.105221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.105737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.106784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.107231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.109331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.119022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 289/574] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:35.119969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.122525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 286/575] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.134293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.136117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5b53c-a0b1-44e2-85d1-f4fa6359fb75 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.144541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc6086-6416-4ac3-ba94-26747d9be69f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.150204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.150340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.150999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.151276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.151662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.151868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.152390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.152796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/9e0131ca364c4f3c98aa0f49f6013a94/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.167200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.169021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.170711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=9e0131ca364c4f3c98aa0f49f6013a94, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.173681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.188165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:35.189340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 287/576] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:35 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/9e0131ca364c4f3c98aa0f49f6013a94/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:35.190596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.194149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 290/577] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.202109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.224033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b4ab-227c-4a09-a208-3fe2d64faa0d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.300763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.301744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.302647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.303662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.305332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.305796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.307606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.322368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 291/578] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.335051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.346045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce56e-db7e-4f99-92a9-378172eb0839 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.356486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549126a-ea3b-4227-9246-c80fb9fbf10d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.358134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.359957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.360903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.361718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.366132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.368260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.372882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.374453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.385855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.386589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:35.388726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.396018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:35.398193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 288/579] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.405819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.409300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:35.410491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 292/580] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:35.415985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.417840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec772ef2-f019-4c37-a9e6-6c5108f837f6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.426939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.427101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5308eb-8f79-4ff8-bd65-bf319184c332 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.429841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.430335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.430826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.431874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.432446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.434360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.438155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.438819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.439096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.439443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.440238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.440544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.442435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.447183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 289/581] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:35.452817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.459576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 293/582] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:35.465803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.466247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee73c57-4db8-4377-86d0-aafb57c03afc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.472218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.473083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.473392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.473664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.484478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb51e4-ef9f-4135-9be5-361c15e18564 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.485691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.487791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.498592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.499482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.499763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.500033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/731b9e74f74e4b4898bb81851831be5e/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.508401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:35.510197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 290/583] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.522103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.523670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=731b9e74f74e4b4898bb81851831be5e, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.526483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.534480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4255b6-99f5-40cd-8c14-ef7de086a909 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.540188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.541004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.541476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.541883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.542792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.543277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.545725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997d65c-21b1-49fe-9ee1-a70efba1ca23 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.558501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 294/584] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:35 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/731b9e74f74e4b4898bb81851831be5e/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:35.567736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 291/585] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.574166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.686621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24cc6-e7f0-41dd-8abd-210fae8f891f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.695925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.696732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.697010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.697306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.706798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e652db-de8c-410f-8b0c-9f5ecdbd3dd5 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.707183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e652db-de8c-410f-8b0c-9f5ecdbd3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.707517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e652db-de8c-410f-8b0c-9f5ecdbd3dd5 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.710290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 292/586] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:35.711089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.714169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.721712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.722230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.726598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.739804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:58:35.750597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 295/587] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.756089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.763624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:35.764927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:35.770174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce58db-3c26-42e9-8318-708bc9b4d06d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.778135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.778894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.779744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.780088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.782403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.782793 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.783194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 293/588] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:35.789176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.811950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.815311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 296/589] 10.222.0.73 () {56 vars in 1160 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.821455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.823545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb20447-a946-45ca-9c50-6594d652462d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.829085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.830115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.830505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.830935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.833882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c53aef-50b8-4e5d-814d-4e672fc76258 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.844209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.845351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.845899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.846306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.846413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:35.855436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:35.857087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 294/590] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.860250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.862712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.862901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.872995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe0ab7-238d-4de9-add6-ed7a5fd3d795 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.877622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.878397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.878777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.879151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.879997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.880405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.882911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.885791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:35.887110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 297/591] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:35.892504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 295/592] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:35.892727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.898407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.903338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9712-367d-4959-91ad-e9a5e88b7b58 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.907891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71eb-bb91-4bfc-85d2-beab38d52d4f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.909228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.910122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.910622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.911094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.911946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.912501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.912779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.913586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.913920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.914245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.914973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.925595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.927299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 298/593] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:35.929105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.932773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.942268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e5dce-3ebb-4bbd-b3a1-840900be6ffe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.947250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.948062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.948389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.948661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.949590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:35.950948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 296/594] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:35.956051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.956697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.958073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.967138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d4e83-7097-4c62-b19e-cc9dbb6980f7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.971799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.972649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.972857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:35.973321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.973770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.974355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 299/595] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:35.974913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.975396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:35.977165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:35.979991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.989641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af413fe3-26a3-452f-a770-add81bdcc618 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:35.989859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 297/596] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:35.995413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:35.997477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:35.998109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:35.998440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:35.998709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:35.999520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:35.999828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.001776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.007556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf1ebe-f49a-42c0-89fb-d633f1e08a51 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.012824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.013823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.014285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.014734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.019981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 300/597] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:36.026144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.035338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.037717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148364de-a9ae-4551-894a-15420a2df0a7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.040071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.049851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.050732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.051004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.051321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/7ce1c786c9fd4009aba04bccafdd01e7/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.058918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:36.070827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 298/598] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:36.076773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.083478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=7ce1c786c9fd4009aba04bccafdd01e7, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.086713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.097179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd4ebb-18bb-4659-be5b-df617a65f7f2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.104654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.105425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.105733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.106049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.107044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:36.107347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.108647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:36.108647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:36.108647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:36.109987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.128872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 301/599] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:36 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/7ce1c786c9fd4009aba04bccafdd01e7/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:58:36.174971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 299/600] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:36.180754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.266240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89705-e436-46a9-81e7-0fc4291ac8ad admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.275911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.276580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.276859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.277163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.285960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.288302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.298922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 302/601] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:36.304581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.318437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6273572a-972c-48ac-8316-6157bdc07e76 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.337379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.338110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.338387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.338658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.350822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.352651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.369540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:36.371057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 300/602] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:36.376626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.385987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4268-2c58-4df4-a9e9-9737dbe4a78c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.390611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.391617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.391754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.392046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.392863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:36.393260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.395005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.407754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 303/603] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:36.413626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.423843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139493f-aa1c-42bd-962d-923e19f17d99 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.429193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.430145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.430494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.430835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.438340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.440407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.454508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:36.456071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 301/604] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:36.462020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.475616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeff51b-7d2f-4332-9c6f-39123540e215 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.484836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.485696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.486236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.486659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.487592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:36.488045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.490035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bb84d-ad5e-4a47-a024-b19c21cfc353 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.518620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 304/605] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:36.524756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:36.536112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b50cdb9-f71d-4f92-8fbf-dae38d32887c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:36.541853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:36.542947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:36.543397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:36.543812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:36.544780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=4a55309bdafe4b12bd50bc6e944bb10c) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:36.545259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:36.547214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac6ddf-37ac-4e7d-b27f-62f125fe5687 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:36.557752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 302/606] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:36 2022] GET /identity/v3/role_assignments?user.id=4a55309bdafe4b12bd50bc6e944bb10c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:37.179910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86defc-9b40-4fb8-a6d2-bed0d48f586d None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.180413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86defc-9b40-4fb8-a6d2-bed0d48f586d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.180488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86defc-9b40-4fb8-a6d2-bed0d48f586d None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.182510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 305/607] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:37.187753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.188149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.188315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.209793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:37.210984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:37.218966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 303/608] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:37.253819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86defc-9b40-4fb8-a6d2-bed0d48f586d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.270764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86defc-9b40-4fb8-a6d2-bed0d48f586d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.278647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.279433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.279710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.279982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.294768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:37.301681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:37.303666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 306/609] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:37.309329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.318795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17288c9b-85e4-40a8-96bc-9a5ccb23956a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.327738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.328420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.328697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.328969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.329770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.330065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.331665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.340576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 304/610] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:37.346443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.361934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224c6f7-600c-4cc9-9d8d-2170c3910425 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.370176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.370954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.371230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.371500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.384884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.386735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.407352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:37.408554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 307/611] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:37.414817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.424575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2d256-9513-4ac8-ad7a-de1951046d3d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.433203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.433861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.434139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.434411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.435129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.435431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.437002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.449216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 305/612] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:37.454282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.464175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925689aa-de77-4e98-bf50-4690f9418c56 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.469315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.470200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.470600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.470940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.479952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.482092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.504754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:37.506377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 308/613] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:37.512172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.524284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954f8ef-664e-49fb-b2c6-a54779514201 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.529625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.530394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.530678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.531013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.531844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.532208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.534119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.559336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 306/614] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:37.565158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.579546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e5bc1-af27-44b3-b148-e9111647b3d2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.584863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.585557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.585835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.586111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.597856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.600216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.615132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 309/615] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:37.621008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.630912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1945-f91c-474e-b03e-c9d0c48578fd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.641218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.642003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.642287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.642557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.653661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.655448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.678467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:37.679928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 307/616] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:37.685252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.696231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618bb96-24d2-4f18-940e-c187bde42814 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.699663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.701191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.701191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.701191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.701191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.701801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.702940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.716155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 310/617] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:37.721265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.731812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4c8f3-733e-4c85-8bd8-326e65a984ad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.736516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.737369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.737647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.737920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.745269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.747247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.760835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:37.762307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 308/618] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:37.770146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.788576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1601e1-7062-4dec-a9c4-5ce229fa5640 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.795420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.796072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.796624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.797136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.798297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.798607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.800532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de726eaa-8551-48c6-b30f-232613ce931f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.818091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 311/619] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:37.823682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:37.835202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab04ff8-e886-4b12-b165-87ef7c6b1409 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:37.842138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:37.842888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:37.843171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:37.843435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:37.844507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:37.844900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:37.848811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609555-e543-420b-a6e4-81ac6ea181fb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:37.862089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 309/620] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:37 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.047113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590079d3-bcd7-4818-b893-b1261d3a5973 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.047479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590079d3-bcd7-4818-b893-b1261d3a5973 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.047674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590079d3-bcd7-4818-b893-b1261d3a5973 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.049647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 312/621] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:38.055211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.055496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.055752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.078093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:38.079271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:38.096000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 310/622] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:38.120342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590079d3-bcd7-4818-b893-b1261d3a5973 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.139089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590079d3-bcd7-4818-b893-b1261d3a5973 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.149578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.150366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.150645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.150924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.163982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:38.171406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:38.172790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 313/623] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:38.181869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.191362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a0658-d986-4eea-b847-ce4fca727036 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.197247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.198101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.198575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.199066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.199975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.200463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.202460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.216627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 311/624] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.221851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.232430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7bc34-8eed-416d-99b2-866785e8bfe8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.237216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.238100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.238380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.238651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.249719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.251592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.269887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:38.271404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 314/625] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:38.277588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.288474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4553e-41a5-4451-b91f-18240e9dc0c2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.293516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.294226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.294509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.294784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.295569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.295877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.297592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.310921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 312/626] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.316415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.326710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e4a30-6935-4376-86cd-fc4de5b22d25 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.331263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.332096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.332376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.332746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.340487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.342621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.357922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 21 09:58:38.359405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 315/627] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:38.365131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.375754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32f322-97ed-4e00-a054-bad36ea91d5e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.380216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.381048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.381357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.381890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.382741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.383097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.384908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.409267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 313/628] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.410875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.421892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261f09f-189d-455e-8b1a-56ee902f8c04 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.426726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.427444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.428300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.428581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.437900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.439654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.450876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 316/629] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:38.456425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.466466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5abf82-9de2-42f0-8c2b-5957657c3d65 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.471713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.472503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.472784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.473074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.483855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.485706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.503551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:38.505027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 314/630] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:38.511306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.520251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f07f4-c254-46b4-8562-dfd5377a4a6e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.524809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.525483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.525761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.526035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.526752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.527057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.528628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.540856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 317/631] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.546293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.556856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26eee32-9d24-45c7-9124-8e9fdcf256c3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.561422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.562259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.562538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.562812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.570699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.572750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.586016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:38.587485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 315/632] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:38.592977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.604323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7929-35d6-4a6b-a196-3478d09e7c6b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.608888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.609613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.609890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.610163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.610998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.611304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.613275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d10ea-fda9-43ec-9ff1-8dd99cda763e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.627090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 318/633] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.633905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.645610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cee04-12d3-4168-9b74-4b822a5199b4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.650363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.651071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.651351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.651627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.652460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=9e0131ca364c4f3c98aa0f49f6013a94) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.652855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.654747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008f832-8f87-491d-8d24-a665194bd18b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.662039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 316/634] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/role_assignments?user.id=9e0131ca364c4f3c98aa0f49f6013a94&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.847297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9ea1-d53f-4489-aff2-6d76af5cde71 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.847634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9ea1-d53f-4489-aff2-6d76af5cde71 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.847841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e9ea1-d53f-4489-aff2-6d76af5cde71 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.850462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 319/635] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:38.855498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.855789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.856066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.874571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:38.875757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:38.885409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 317/636] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:38.908246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e9ea1-d53f-4489-aff2-6d76af5cde71 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.922711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e9ea1-d53f-4489-aff2-6d76af5cde71 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.928954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.929824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.930103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.930386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.944269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:38.951319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:38.957172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 320/637] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:38.959214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:38.968523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc1c5-9082-481a-90f1-d6f1fde2c678 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:38.975788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:38.976448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:38.976729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:38.977003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:38.977782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:38.978089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:38.979675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:38.988872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 318/638] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:38.994725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.004509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e931ba-2757-40a3-8827-53847ada2203 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.014000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.014735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.015075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.015348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.028697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.030540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.050073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-874a0574-c951-46a1-b43a-e4b7a2f5a06a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:39.053314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 321/639] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.057763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.066558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473343-dd7b-42e9-b398-2b3d8da6efc8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.066558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473343-dd7b-42e9-b398-2b3d8da6efc8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.066558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2473343-dd7b-42e9-b398-2b3d8da6efc8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.068253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 322/640] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:39.071532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061814a-c1e8-4ad3-88d6-4743a05f4ca7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.074750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.075034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.075313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.077515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.078424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.078919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.079405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.080365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.080911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.083113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.098994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:39.100696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:39.109096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 319/641] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.110651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.112508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 323/642] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:39.122180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb42d9a-5d72-4f57-a061-6c7654e6df4f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.133614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.134465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.134793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.135013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.141456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.144862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.148005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.154269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd157b-bcee-4ebf-a54f-e6c07b95c3ec None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.160747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.161559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.161838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.162693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.166954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:58:39.173415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 320/643] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.180637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:39.182132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.187853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:39.189486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 324/644] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:39.197569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.200225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb7b9d-c523-4aab-abf1-5b7c7ef40d09 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.212202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.212871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.213171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.213444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.214288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.214590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.216428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.220652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5accf-72fd-4497-aa33-666dad650fbb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.230945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.231635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.231876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.232148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.232892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.233219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.234799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.256273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 325/645] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.256995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 321/646] 10.222.0.73 () {56 vars in 1158 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.262159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.263373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.280068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301a89-8f77-4577-abbc-a8ce83d1eaf7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.283883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61302a-470e-45e8-9e11-f00020b2d487 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.290948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.291738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.293390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.294287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.295095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.295961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.296235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.296502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.312176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.313945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.318838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.320647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.332319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 322/647] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:39.336863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.343877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:39.345395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 326/648] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:39.345503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e3ef2-08f3-4c65-9cd0-31a64df82a31 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.357204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.365363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.366215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.366496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.366769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.372836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0469f62-7878-4b39-a488-5dcd9ac634da admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.384107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.385964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.386967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.387625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.387904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.388168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.388886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.389217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.390763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.418035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:39.419321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 323/649] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:39.426021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 327/650] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.427292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.431433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.441560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2afde-c649-4d34-a3b1-7ae3b5153be3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.445981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d919fb-a354-427a-8d67-78921b14cd84 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.450792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.451443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.451720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.451996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.452706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.453009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.454261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.454616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.455094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.455375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.455650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.467026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 324/651] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.471319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.473348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.475568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.485524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b754923-3b4c-415c-90d7-3b51c9064f2c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.490416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.491442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.491898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.492414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.499202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 21 09:58:39.500945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 328/652] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:39.508222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.513910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.515863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.519107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9aded-2248-4fbe-bd0b-e38ab6438bea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.524663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.525562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.526066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.526652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.527708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.528190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.530482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.536575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:39.541906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 325/653] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:39.550046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 329/654] 10.222.0.73 () {56 vars in 1160 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.551712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.559525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.563816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487cdd3-d478-4d0f-ba07-eba58d5bac52 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.569280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.570161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.570625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.571075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.572003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f230-d799-4a71-9e1a-b8f6f558f4c1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.572244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.572729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.574933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f3d0a-1faf-4ae8-9dbc-5a81506cc5d2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.577153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.577828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.578111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.578649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.587754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.589577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718dd5c-bfc7-4322-a902-a3f889df80b8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.589983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 326/655] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.591517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd6df-1082-42df-98d0-4412ff90fcd7 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.591977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd6df-1082-42df-98d0-4412ff90fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.592422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdd6df-1082-42df-98d0-4412ff90fcd7 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.594663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 327/656] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:39.595540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd6df-1082-42df-98d0-4412ff90fcd7 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.603472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 330/657] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:39.605353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.605639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.605937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.609651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdd6df-1082-42df-98d0-4412ff90fcd7 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.614576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.615841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.616189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.616550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.617480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=731b9e74f74e4b4898bb81851831be5e) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.617869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.619733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.626199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 328/658] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/role_assignments?user.id=731b9e74f74e4b4898bb81851831be5e&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.627241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.628367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:39.629823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:39.638148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa495-5204-4963-b3b0-fb21c59fe213 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.640339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 331/659] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:39.645132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.645132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.645132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.645132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.657090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.659031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.669805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.683921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f38f76-1084-448e-aad9-4dc8679cec30 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.689077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:39.692118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 329/660] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.694830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.695535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.695815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.696087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.697540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.718326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df623-5fe8-4c89-9a8f-183563c5734f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.721247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:39.729450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:39.731197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 332/661] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.732993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.733701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.733979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.734255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.734991 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.735298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.737346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.737460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.752842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcf9ad-4d2e-489f-a896-6640a7ac2108 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.764965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.765715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.765995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.766526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.767377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.768212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 330/662] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.768339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.769993 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.773837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.789411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fd650-056c-4cf7-9e9d-b6cdaf08beb4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.794582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 333/663] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:39.801388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.809815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.810858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.811305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.811716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.812730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd31210-171f-4220-9f29-c98129b58529 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.818332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.819341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.825079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.825079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.825313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.825313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.841941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.850961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.851637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:39.853150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 331/664] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.858666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.874156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e42d19-1094-40ce-889b-8368d4f64ed3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.878198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:39.879399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 334/665] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.884180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.884847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.885152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.885431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.886228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.886534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.888378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.890004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.902580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 332/666] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:39.904046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bc2-1166-480a-a1c5-3a1899d61e44 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.908062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.919242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.919396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68f910-ea02-44ce-a308-b685b293cd6f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.919953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.920175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.920442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.921214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.921516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.923207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.926996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.927932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.928424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.928987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.930039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7ce1c786c9fd4009aba04bccafdd01e7) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:39.930548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.932573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.937255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 335/667] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:39.939276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 333/668] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/role_assignments?user.id=7ce1c786c9fd4009aba04bccafdd01e7&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:39.946227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:39.956130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e987737-a57b-4be7-9693-b5db8930300c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:39.963689 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:39.964501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:39.964777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:39.965045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:39.974058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:39.976680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:39.991174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:39.992739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 336/669] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:39.998353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.011635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26279ee-354d-49ca-a71c-eb9dceb4eee8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.018036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.018731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.019012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.019285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.020150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:40.020459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.022924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.043990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 334/670] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:40.049569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.059730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474dee3-c8b9-4f16-8eda-73962000d712 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.064541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.065365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.065696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.065966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.083175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.085646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.107071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:40.108378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 337/671] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:40.114029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.129027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2125-dfa3-4229-aa51-1faccc5bd16c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.134556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.135292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.135575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.135989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.136775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:40.137108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.138798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.157298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 335/672] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:40.163541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.174423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf200-55a4-4db4-9a5f-06dd48b41f14 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.178894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.179674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.179949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.180219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.187335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.189293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.203378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:40.205261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 338/673] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:40.213081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.221880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3e5e9-4d20-4ccd-86d1-85c2b4ff6b23 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.228311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.228975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.230141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.230420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.231218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:40.231523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.233393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b7a9e-5d2c-4395-8c6f-cbf7c9a39aa1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.250790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 336/674] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:40.257546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:40.267923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf0bd-3818-4974-ab65-ff50ab94ad45 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:40.273621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:40.274783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:40.275251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:40.275727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/4a55309bdafe4b12bd50bc6e944bb10c/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:40.292858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=4a55309bdafe4b12bd50bc6e944bb10c, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:40.295970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b306337-d0c1-486c-a910-78a9b7e169be admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:40.311966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 339/675] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:40 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/4a55309bdafe4b12bd50bc6e944bb10c/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:41.025450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9170e-601d-4edf-9014-fc137f0dda19 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.026026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9170e-601d-4edf-9014-fc137f0dda19 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.026484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9170e-601d-4edf-9014-fc137f0dda19 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.028699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 337/676] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:41.033676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.034155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.034604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.053498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:41.054999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:41.144746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 340/677] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:41.182444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9170e-601d-4edf-9014-fc137f0dda19 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.200052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9170e-601d-4edf-9014-fc137f0dda19 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.211408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.212214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.212493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.212762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.232997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:41.239961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:41.241504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 338/678] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.247222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.257410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc49c9-e9dc-488a-8de1-0b68878e54e0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.265206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.265874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.266154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.266426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.267175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.267479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.269081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.285671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 341/679] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.292322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.304229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e7f2-7ec7-4378-be20-ee48d3e0cbc5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.312460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.313446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.313729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.314000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.328883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.330855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.356105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:41.357384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 339/680] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.363057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.374304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290d159-ef76-40eb-b066-187c3fd0ba24 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.385425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.386082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.386360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.386633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.387358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.387661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.389266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.402359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 342/681] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.410179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.421852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad4398-c543-4c2c-94c0-9ff5ccf24253 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.428892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.429755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.430098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.430375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.440269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.442361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.457805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:41.459563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 340/682] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.465478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.476130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2badb2-77fb-4e68-90ed-54be0bab963f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.485214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.485876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.486216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.486466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.487406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.487714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.489608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.508371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 343/683] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.513713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.524881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc9af-162e-4419-8d15-69e38f82f431 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.531981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.532608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.532889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.533191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.546083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.547817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.562388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 341/684] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:41.568174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.581884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40f647-69e9-4c88-baf5-3a58e9a36169 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.593693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.594477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.594758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.595027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.608593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.610431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.635408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:41.640727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 344/685] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.641957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.658132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909415f-8168-40df-be03-ab9978a4c08b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.670988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.671694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.671977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.672303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.673038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.673435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.675010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.696388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 342/686] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.702014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.718224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff57987-ca29-4b12-8627-441141c7c54c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.729257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.730088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.730371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.730645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.746263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.748213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.762708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-f5d36332-93f1-4138-8a19-973883057e7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:41.763948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 345/687] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.770101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.776415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c51c7-cb33-43af-a241-48cbeea5671a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.776415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c51c7-cb33-43af-a241-48cbeea5671a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.776415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c51c7-cb33-43af-a241-48cbeea5671a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.776415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 346/688] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:41.782578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.783122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.783620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.789860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78a5b-0d2a-4a36-82c7-807e4de6f54a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.804543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.805568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.806068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.806596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.807592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.808115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.810256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.814076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:41.816229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:41.837869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 343/689] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.839494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 347/690] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:41.845980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.858446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb76e-e109-46f8-b511-179e38458c91 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.868631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.869571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.870084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.870557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.871580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.872089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.874156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.880625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 348/691] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:41.904045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.917930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14a91e-2f1b-473c-9a53-03ac31074498 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.928870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.930111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.930698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.931179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.946985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:41.949235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:41.968208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:41.969770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 344/692] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:41.976116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:41.987135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77178fe7-8561-4556-ac2c-a896afe11702 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:41.995958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:41.996956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:41.997481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:41.997953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:41.998925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:41.999428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:42.001367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0a37e-821a-4934-94fb-1d1e3dba6c4e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:42.018748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 349/693] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:42.024519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:42.037374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac18877-8d26-433b-8065-572273919ca5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:42.045666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:42.046737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.047248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.047783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.048826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:42.051081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369abb-cc60-4663-b8f6-3610d92ea647 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:42.105832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 345/694] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:58:42 2022] POST /identity/v3/users => generated 254 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:58:42.675549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eecbf-0db6-4ff2-871b-6a0be9a37efb None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.676544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eecbf-0db6-4ff2-871b-6a0be9a37efb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.677038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eecbf-0db6-4ff2-871b-6a0be9a37efb None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.679815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 350/695] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:42.687240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.688215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.688699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.709829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:42.711380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:42.719786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 346/696] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:42.743579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eecbf-0db6-4ff2-871b-6a0be9a37efb None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:42.756368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eecbf-0db6-4ff2-871b-6a0be9a37efb None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:42.761616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:42.762663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.763146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.763616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.764461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:42.765692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:42.765692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:42.765692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:42.767068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:42.780784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:58:42.782621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 351/697] 10.222.0.73 () {56 vars in 1150 bytes} [Mon Feb 21 09:58:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:42.789280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:42.798936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97023ec2-13eb-4700-966b-ea116d7d0aee None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:42.804673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:42.805797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.806283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.806811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.807772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:42.808342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:42.809619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:42.809619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:42.809619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:42.810939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284e3e4-4762-4143-9376-e60546f5394c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:42.816698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 347/698] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:42.822429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:42.835982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e86e78-12a4-4921-bc86-208c32382858 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:42.841008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:42.841995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:42.842527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:42.843001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:42.843962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:42.844475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:42.845823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:42.845823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:42.845823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:42.847025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4083c-a14f-4a4e-9e50-77b79c7f289f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:42.853970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 352/699] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:43.064373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228eb9e-f650-419f-b89c-f345e3fb5aba None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.065022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228eb9e-f650-419f-b89c-f345e3fb5aba None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.065569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228eb9e-f650-419f-b89c-f345e3fb5aba None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.068170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 348/700] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:43.073526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.074106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.074584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.104713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:43.105913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:43.116323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 353/701] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:43.139479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228eb9e-f650-419f-b89c-f345e3fb5aba None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.155187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228eb9e-f650-419f-b89c-f345e3fb5aba None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.162416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.163439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.163868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.164286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.175485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:43.184103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9cefb28b-ae48-45ab-b166-9b38a1cf1cb6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:43.185934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 349/702] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.191245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.203246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a8074-7334-4099-a9cd-365c0fe59bf4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.215145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.216065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.216526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.216978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.217933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.218438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.220198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.232222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 354/703] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:43.236407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2744c-c4b9-4e68-b485-218d7d2b0989 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.236890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2744c-c4b9-4e68-b485-218d7d2b0989 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.237396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2744c-c4b9-4e68-b485-218d7d2b0989 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.239447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 350/704] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:43.241196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.244841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.245144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.245449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.252268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4150408-7f85-405f-b0be-0584f31455aa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.263023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.264108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.264569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.265146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.270083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:43.271395 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:43.280248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.283468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.290840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 351/705] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 21 09:58:43.307935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:43.309687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 355/706] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.318271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.325476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.330201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323a9d4-df9a-4e6d-9b11-71fc3e814164 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.341435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.342466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.342949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.343399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.344358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.345774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.347679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.351976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda16841-c4f5-4335-951e-3f7d55f2dce2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.363541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.364664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.365745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.366197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] PATH_INFO: `/v3/services/network` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.367434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.370415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.373002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 352/707] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:43.378372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.394341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bbfc4-351a-4b68-ac9c-69dee395d228 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.396317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:58:43.397720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 356/708] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/services/network => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.402139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.404030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.404589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.408863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.409327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.421474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cdadb-cf77-4d59-bb59-344951022ebf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.425581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.431062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.431850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.433279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.433887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.434645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.436499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] RBAC: Adding query filter params (name=network) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.437759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.442051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.448306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 357/709] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:43.453785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.461367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:43.465096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 353/710] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.467520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead1b39-8726-4ee7-a213-4a7608aff9be admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.469205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.481103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.482252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.483313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.484300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.485214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.487119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59307f3-095a-4022-bc7a-be6f9db5c409 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.487616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.490670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.499244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.500290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.500716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.501234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.502285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.502845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.504760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 358/711] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:43.505273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.541149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 354/712] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:43.546930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.566515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d4aaf-6466-4a7c-850b-b9b7bad60688 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.577666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.578242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.578525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.578801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.597026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.598821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.615404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 359/713] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:43.621515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.635033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4707-c39d-4857-8589-df761279a4dc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.643688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.644507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.644789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.645078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.662661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.664489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.688174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:43.689616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 355/714] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.695946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.705661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c15b3-e9b7-4476-94b5-c83585ae4431 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.713336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.713960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.714239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.714515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.715229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.715535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.717139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.735883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 360/715] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:43.739168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.750513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8408f-d173-4fad-8505-699b7bb6d185 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.757462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.758242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.758523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.758808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.770213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.772190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.788900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:43.790276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 356/716] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:43.796163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.806485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dec83-5466-4439-8d77-bfabdedcd8ef admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.815409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.816061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.816342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.816618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.817437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.817743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.820127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b548d5-0f6c-4ea8-b6b2-4b9150a387e8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.838549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 361/717] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:43.844397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:43.858076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61875cb-d670-42ef-b58a-fc27c32d9543 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:43.867073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:43.867729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:43.868007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:43.868280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:43.869138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=4a55309bdafe4b12bd50bc6e944bb10c) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:43.869447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:43.871270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a3cf-2895-4033-aca3-4f85b86c18ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:43.882511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 357/718] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:43 2022] GET /identity/v3/role_assignments?user.id=4a55309bdafe4b12bd50bc6e944bb10c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:44.678645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab1b8-9342-470f-bc45-f7129066bb07 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.679054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab1b8-9342-470f-bc45-f7129066bb07 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.679224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ab1b8-9342-470f-bc45-f7129066bb07 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.680984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 362/719] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:44.687379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.687666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.687944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.708107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:44.709320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:44.722721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 358/720] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:44.747291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab1b8-9342-470f-bc45-f7129066bb07 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:44.766753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ab1b8-9342-470f-bc45-f7129066bb07 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:44.771422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:44.772209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.772490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.772765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.794254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:44.801279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:44.803319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 363/721] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:44.808981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:44.822309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49381eab-a735-455f-8dc4-7d34fa6545e7 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:44.831841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:44.833037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.833629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.833942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.834864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:44.835179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:44.836872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:44.856337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 359/722] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:44.861918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:44.872428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4271b3-fe2f-4ecb-9f2e-b2b17b484430 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:44.881656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:44.882457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.882739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.883020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.894596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:44.896450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:44.918097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:44.919630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 364/723] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:44.925645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:44.942690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4bd1e-92b4-4159-952b-d6f94478c5a3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:44.954351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:44.955026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:44.955309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:44.955585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:44.956317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:44.956627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:44.958247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:44.976843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 360/724] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:44.982122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:44.992640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571394a9-aa08-4fa3-87ce-652e41805f6e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.001171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.002049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.002330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.002604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.017413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.019425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.039228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:45.040738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 365/725] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.046297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.060501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed072-a814-47b1-a943-098dbd9917bf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.065259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.065924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.066206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.066482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.067324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.067633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.070036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.096794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 361/726] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.102224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.112300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41723697-c635-4506-b599-ca5bb62493b9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.121200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.121987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.122265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.122533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.139526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.145428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.167085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-edd3c5e2-5ca8-4bb2-9627-ef38cfe02fdc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:45.168552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 366/727] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.174013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.196185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3543b-e454-4253-9791-8044fa48a057 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.207851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.209076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.209427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.209742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.211190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.211761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.213755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.218352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f78a8-49c8-405d-96e5-149d1b94df85 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.218629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f78a8-49c8-405d-96e5-149d1b94df85 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.218899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f78a8-49c8-405d-96e5-149d1b94df85 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.221037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 367/728] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:45.226935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.227204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.227480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.235845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 362/729] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.255317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.261648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:45.262841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:45.268443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a956d-5d61-42ce-903b-c1ec66f4f07b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.276890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.277692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.277972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.278250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.280752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 368/730] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:45.294747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.296687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.311292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:45.312759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 363/731] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:45.318685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.327890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a651b-291e-4b1a-83d0-60faf1de2e2f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.329617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.340514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.343954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.343954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.343954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.345242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c606da-59c2-4f01-972f-e5cdb61bd77f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.352852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:45.354552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.355433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.355927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.356389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.357385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.357899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.359903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.360150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:45.361647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 369/732] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.367511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.387744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 364/733] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.388200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3ba3d-7ab5-41e6-a518-fc34a7cca7cf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.393573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.401728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.402393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.402667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.402933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.403683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.403984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.405593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.409181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2dcb2-a96a-4370-9b92-2b433e6dadb9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.418668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.419552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.419829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.420103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.423343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 370/734] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.428144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=3f538116ef3047e092d7680577ac75f1, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.430909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.435415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.446944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23aba2-b88f-4f85-8955-48c8c2845203 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.465255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 365/735] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:45 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:45.466186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.467038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.467361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.467682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.479917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.481835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.500874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:45.506325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 371/736] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.509216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.591770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84baec-376a-4c7d-8833-f04630e8b6ad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.600765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.601815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.602291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.602755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.603684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.604207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.606066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572b2f8-8d0a-4ebe-9dbd-3326ede328db admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.627591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 366/737] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.633269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.650460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebb781-2c06-485d-b1ac-77f07b16e4a9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.663074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.663944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.664166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca899b-6c3a-482b-b090-813a7bdfb605 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.664271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.664456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca899b-6c3a-482b-b090-813a7bdfb605 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.664573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.664735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca899b-6c3a-482b-b090-813a7bdfb605 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.666806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 367/738] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:45.672929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.673246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.673520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.675491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.678647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.694709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:58:45.700322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 372/739] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.701504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.706209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:45.707592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:45.712046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003091b1-034c-47a5-b89b-cf9c661a29a1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.716661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.717078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 368/740] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 21 09:58:45.717518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.717697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.717969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.718956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.719261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.721208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.742764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 373/741] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.745902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.747549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.755961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea693-b9e1-4a39-997b-3a340b0be22c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.760492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128529a-932f-468a-bbc4-db384ab88af0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.764132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.765013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.765300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.765662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.765960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.766075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.766302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.766646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.767649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.768799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:45.768799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:45.768799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:45.769971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.777596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.779796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.790267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 369/742] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:58:45 2022] POST /identity/v3/services => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:45.792897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 374/743] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 09:58:45.797224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.835865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd1b3c-156f-4b90-9e9e-eb1b8b4db773 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.841303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.842475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.842982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.843504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.855781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.858175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.877727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:45.884959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 370/744] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.886613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.897104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf27d70-51fd-4e8e-8fa1-e44a189beae3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.902434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.903390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.903813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.904226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.905206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:45.905670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.907460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.925195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 375/745] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:45.926964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.938273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997c1d1-ec94-466f-8a12-21ad78b1523c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:45.944122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:45.945271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:45.945749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:45.946168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:45.954614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:45.956984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:45.972444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:45.979885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 371/746] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:45.981670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:45.993965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935d6d-da95-49e2-96da-9dd26d06e176 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:46.003254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:46.004203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:46.004637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:46.005100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:46.006112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:46.006861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:46.008928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b011e-afbe-47b6-9c26-1d82c494ef10 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:46.026366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 376/747] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:46.030254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:46.043978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa429fc-0a8d-4379-8ac7-4f4b2d0aceb9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:46.048702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:46.049401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:46.049707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:46.049948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:46.050789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=ed9393f0271a41a989524759a68dfc3c) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:46.051097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:46.053022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ce0c-0dac-4e43-b7b1-3baac5a4d5cc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:46.059749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 372/748] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:46 2022] GET /identity/v3/role_assignments?user.id=ed9393f0271a41a989524759a68dfc3c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:46.458653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a0ebd-7c1e-4840-af0e-e18f7e6efea4 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:46.459489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a0ebd-7c1e-4840-af0e-e18f7e6efea4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:46.459720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a0ebd-7c1e-4840-af0e-e18f7e6efea4 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:46.461804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 377/749] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:46.466674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381038a-03a6-4c70-a22c-5eb149de23bf None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:46.466957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381038a-03a6-4c70-a22c-5eb149de23bf None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:46.467227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381038a-03a6-4c70-a22c-5eb149de23bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:46.494065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b381038a-03a6-4c70-a22c-5eb149de23bf None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:46.495313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b381038a-03a6-4c70-a22c-5eb149de23bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:46.503330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 373/750] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:46 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:46.538719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a0ebd-7c1e-4840-af0e-e18f7e6efea4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:46.558634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a0ebd-7c1e-4840-af0e-e18f7e6efea4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:46.565640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:46.566297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:46.566577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:46.566852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:46.567570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:46.568644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:46.568644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:46.568644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:46.569529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c38560-3993-4f55-97e9-6b62053c5a88 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:46.606670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 378/751] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:58:46 2022] POST /identity/v3/services => generated 240 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:47.294379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a7878-296d-4757-b5b9-fab8f170596a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.295385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a7878-296d-4757-b5b9-fab8f170596a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.295867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a7878-296d-4757-b5b9-fab8f170596a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.298180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 374/752] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:47.303775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.304596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.305089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.328988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:47.330496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:47.354655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 379/753] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:47.391727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a7878-296d-4757-b5b9-fab8f170596a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.410962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a7878-296d-4757-b5b9-fab8f170596a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.418967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.420014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.420508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.420977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.433919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:47.441464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:47.449048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.453386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 375/754] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:47.458339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4333-cf91-464d-905b-889d7a39f340 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.466524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.467432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.467919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.468400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.469385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:47.469884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.471669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.484984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 380/755] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:47.490559 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.506987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9395a-be9b-473d-b8d4-1cdfb14ecca9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.515952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.516954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.517455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.517955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.533545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.535845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.552920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:47.554681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 376/756] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:47.562115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.573347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9b8f1-cd31-4179-b27b-e9cc2a5c7988 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.580211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.581137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.581664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.582151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.583116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:47.583693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.585585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.598193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 381/757] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:47.606207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.619219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985cc176-9dbe-46cb-95b3-7436e6f2d08b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.626228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.627396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.627939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.628405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.640430 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.642887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.660144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:47.662015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 377/758] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:47.667805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.681424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb57a-5863-4f66-9dd6-4f1181bde374 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.686562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.687484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.687984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.688499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.694051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:47.694575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.696804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.715162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 382/759] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:47.720652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.731136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668eae09-0367-4d9e-8cd0-b3a85cbf83a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.737975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.738882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.739450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.740453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.752479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.754565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.765708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 378/760] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:58:47.771138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.782202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c94910-a866-45d9-a34b-15f2fba44c61 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.791402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.792471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.792973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.793510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.811085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.813356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.833823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:47.835381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 383/761] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:47.840966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.850867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae22a49-c46a-4a0b-b8d9-877b12ecec49 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.859252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.860172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.860697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.861209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.862176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:47.862728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.864544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.880315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 379/762] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:47.886031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.902014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96232-47c0-4f64-a678-61635319f0dc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.910667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.912240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.912732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.913301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.926179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.928697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:47.948691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:47.950206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 384/763] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:47.955817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:47.970284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5144c2c-ee9f-436d-8970-2c4f83ec6deb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:47.975728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:47.976702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:47.977235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:47.977728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:47.978751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:47.979255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:47.981535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5855a-fbaa-4b31-9dde-32f95ea1228e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.001152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 380/764] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:48.007082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.022259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9ae70-f7cb-47e2-98f7-de794d6b6d7b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.033377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.034025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.034298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.034567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.035393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=4a55309bdafe4b12bd50bc6e944bb10c) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.035699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.038374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e244-e46a-4349-89f1-66ff3a42dd6d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.047098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 385/765] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/role_assignments?user.id=4a55309bdafe4b12bd50bc6e944bb10c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:48.557094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693296-cce6-4240-82d1-3b43d1914895 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.558115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693296-cce6-4240-82d1-3b43d1914895 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.558609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45693296-cce6-4240-82d1-3b43d1914895 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.560892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 381/766] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:48.566559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fa34-fd06-4c38-9fad-f5cc6377bac7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.567443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fa34-fd06-4c38-9fad-f5cc6377bac7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.568452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0fa34-fd06-4c38-9fad-f5cc6377bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.587017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-cab0fa34-fd06-4c38-9fad-f5cc6377bac7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:48.588503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cab0fa34-fd06-4c38-9fad-f5cc6377bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:48.601148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 386/767] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:48.620700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693296-cce6-4240-82d1-3b43d1914895 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.637622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45693296-cce6-4240-82d1-3b43d1914895 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.645671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.647274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.647786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.648255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.651952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d12c-e244-4572-a751-950072f6e561 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.652475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d12c-e244-4572-a751-950072f6e561 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.652945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d12c-e244-4572-a751-950072f6e561 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.655055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 387/768] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:58:48.661160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.661444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.661760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.665819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:48.672944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:48.679186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 382/769] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:48.680680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.691081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ed833-60c3-4d65-a876-f66416345aab admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.696458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.697374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.698013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.698488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.699455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.699972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.701814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.702023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:48.703212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:48.716252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 383/770] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:48.717723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.726646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 388/771] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:48.728147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24997b0f-5548-42b1-ae98-852a6cabdc19 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.733160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.734180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.734724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.735292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.746400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.748620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.765864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.770766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:48.777151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 384/772] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:48.778887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.780478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547e3a4-7ddd-4227-98d7-a6fb349b3013 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.789359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b093f4-2a22-44dd-a097-d4849e742a81 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.794357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.795279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.795757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.796264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.797210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.797884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.799777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.801686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.802513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.802791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.803060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.803712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.805289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.816707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 385/773] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:48.819764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.829464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fd355-f53b-44a0-acf5-cb1f48626cb3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.831532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:58:48.832982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 389/774] 10.222.0.73 () {56 vars in 1150 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:48.835794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.836843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.837391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.838018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.838801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.846867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.849237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.859316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9dcf-8a47-4b44-9030-71568381e137 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.863678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:58:48.869226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 386/775] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:48.871293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.878249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.878911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.879190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.879462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.880173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.881009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.882854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.884319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e432465-6d91-4102-a098-962f6fbf47dd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.897396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.898410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 390/776] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:48.898702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.899195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.899733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.900860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.901650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.902631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.908419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.920567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde78839-2578-4441-8db1-7f78c2993a13 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.925015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.925695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.925973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.926241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.926933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.927757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.929331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f59a9-ba41-4828-aef6-225f074e15b2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.936932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 391/778] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:48.936932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619318f6-3069-49b7-869d-d780598441f0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.936932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619318f6-3069-49b7-869d-d780598441f0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.936932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619318f6-3069-49b7-869d-d780598441f0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.937618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 387/778] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:48.938147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 392/779] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:48.939402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.942678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619318f6-3069-49b7-869d-d780598441f0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.952933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0287e4-16ec-49d7-96ab-ab65835a52a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.955031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619318f6-3069-49b7-869d-d780598441f0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:48.959158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.959441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:48.960059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.960330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.960598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.960956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.961396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] RBAC: Adding query filter params (interface=public, service_id=7b46856d5cd5478cbc17f2e7851eb622, region_id=RegionOne) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:48.961705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.961900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.962393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.962691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:48.962691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:48.962691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:48.963545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea742f-1e9c-464f-b177-378b5f69c1ad admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.971312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 393/780] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/endpoints?service_id=7b46856d5cd5478cbc17f2e7851eb622&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:48.971949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:48.972597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:48.972877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:48.973169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:48.974925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:48.989606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 388/781] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:58:48.990936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:48.991461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:48.992104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:48.999943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 394/782] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:49.000693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.003077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598913-0732-4a78-8072-757841d4191d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.008710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.009684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.010168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.010682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.011577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.013532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.018951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 389/783] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:49.029266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9d28b-6b6b-4192-b606-65b3a460bafc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.037862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.038763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.039573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.039848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.040119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.051746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.053655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.053791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90208727-9467-4bf9-bdc6-9264d2e732fe admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.065129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.065943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.066221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.069646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.072028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:49.073594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 395/784] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:49.079266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.096869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:49.102343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03508c0-1b0a-4505-b206-9ffa250ba2d3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.108408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:49.110818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 390/785] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:49.117622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.119068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.119762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.120039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.120309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.121542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.124024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.127942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.141942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9047c4-9824-45c1-9b8d-01298c92e2b3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.152134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.152806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.153846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.154123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.154581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 396/786] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:49.155334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.155608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.157330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.160896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.176557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea06258-2b1a-428d-8392-0acb76b8cba0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.180733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 391/787] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:49.188539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.192557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.196571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.196905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.197134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.204164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc0ac1-7fa1-4efa-b3f3-779d21ef8aa5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.211140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.215027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.217681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.218947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.219229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.219508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.233286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.235022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:49.235225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.236517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 397/788] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:49.243105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.254727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d845b00-4513-414b-a853-6b72b3802f2d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.260326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.261180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.261601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.261743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:49.262167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.263085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.263492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 392/789] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:49.263752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.265932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.269077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.278945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 398/790] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:49.281447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f40ba3-6e94-4bc8-8c70-8314d76a0ef1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.285216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.290512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.291487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.292193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.292702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.293853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.295038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.297298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.298081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82740e-7070-40be-837f-e7a04d2d33a4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.302869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.303591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.303939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.304282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.305202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.305631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.307512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.312852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 393/791] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:49.317146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 399/792] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:49.323935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.335784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d589-2e3e-4399-a7c4-b3d66233d672 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.341124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.342327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.342837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.343283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.352810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.355183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.370743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:58:49.372292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 394/793] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:49.378040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.389736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb07eb6-bf84-4e8e-8579-04308cf1eef9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.394877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.395952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.396973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.397467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.398549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.399075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.401227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.421708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 400/794] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:49.430474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.441184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160b2e8-a1ba-4992-88fc-98f6c961a4f7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.448261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.449474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.449925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.450396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.463663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.465999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.488375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:49.490387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 395/795] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:49.496023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.507937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177bce5-c0a1-41c7-8584-a070447231e6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.513183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.514252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.514703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.515140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.516033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.516561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.518511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.532695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 401/796] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:49.539007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.553502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054987c5-3b17-4ab4-9099-7d0ce81f811c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.558563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.560038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.560485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.560994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.568732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.570935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.585353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:49.587042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 396/797] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:49.592786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.604010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09719e-c4fc-4d12-8789-3bb7a23763ad admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.609021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.609918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.610402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.610856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.611865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:49.612338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.614509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509fb43-7c77-4b63-b3f1-9ed4cabee0f8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.628581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 402/798] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:49.634929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:49.650315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5ea08-6ed0-4201-83a9-d1e82e98cd36 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:49.657087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:49.658390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.658865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.659320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/ed9393f0271a41a989524759a68dfc3c/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.681449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=ed9393f0271a41a989524759a68dfc3c, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:49.684370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe3cd1-eae0-4d5f-886b-1fbd7ef5ecd7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:49.701551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 397/799] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:49 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/ed9393f0271a41a989524759a68dfc3c/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:49.875475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24d12-2d18-4e63-98c0-bb1994fb9c8a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.875717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24d12-2d18-4e63-98c0-bb1994fb9c8a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.875943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e24d12-2d18-4e63-98c0-bb1994fb9c8a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.878055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 403/800] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:49.884876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:49.885424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:49.885869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:49.910703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:49.911961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:50.003151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 398/801] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:49 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:50.039291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24d12-2d18-4e63-98c0-bb1994fb9c8a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:50.058740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e24d12-2d18-4e63-98c0-bb1994fb9c8a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:50.064325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:50.065369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:50.065844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:50.066329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] PATH_INFO: `/v3/services/network` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:50.067157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:50.068976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:50.084326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:58:50.086087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 404/802] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:50 2022] GET /identity/v3/services/network => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:50.093580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:50.106068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e4228-4f2b-43c7-8ad6-14145b82472a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:50.121719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:50.122395 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:50.122678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:50.122950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:50.126142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:50.126142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:50.126142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:50.131689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 399/803] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:50.137119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:50.148049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b449411-246e-4478-a877-d8189ce598fe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:50.157837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:50.158730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:50.159232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:50.159675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:50.160602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:50.161106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:50.163500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:50.173077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 405/804] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:50.175034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:50.186388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebd90-ee04-4d92-9b82-93c2f8c653f8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:50.191000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:50.191652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:50.191932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:50.192202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:50.193658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] RBAC: Adding query filter params (interface=public, service_id=6d7686f99eee431581e9ffcff8d0abbd, region_id=RegionOne) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:50.193975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:50.195036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:50.195036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:50.195036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:50.195906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354aa60-6eb4-4537-ab5c-d8c9eca40dcd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:50.204721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 400/805] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:58:50 2022] GET /identity/v3/endpoints?service_id=6d7686f99eee431581e9ffcff8d0abbd&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:50.210005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:50.220012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558a0cd-10be-463d-8d13-adf4aa5de894 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:50.224771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:50.225591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:50.225975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:50.226347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:50.227170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:50.228912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76f1e5-5dc2-4190-8f15-d6ec0b67bb66 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:50.234710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 406/806] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:58:50 2022] GET /identity/v3/services => generated 772 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:51.091176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08326-0ed0-4a1e-8f30-99ada3a2652b None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.091176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08326-0ed0-4a1e-8f30-99ada3a2652b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.091176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c08326-0ed0-4a1e-8f30-99ada3a2652b None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.092887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 401/807] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:51.098734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.099670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.099823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.117912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:51.119082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:51.127142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 407/808] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:51 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:51.151134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08326-0ed0-4a1e-8f30-99ada3a2652b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.164525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c08326-0ed0-4a1e-8f30-99ada3a2652b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.169040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.169860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.170143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.170421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.181709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:51.188509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:51.190142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 402/809] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:51.195875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.205041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105de6-fb39-45d3-85c2-6832db15928c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.210125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.210774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.211060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.211333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.212087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:51.212390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.213990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.222810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 408/810] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:51.229083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.244369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425e5bc-3f4e-4d43-acc0-7544e73baec2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.248920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.249733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.250014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.250289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.261207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.263032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.280260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:51.281737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 403/811] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:51.288229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.298393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c5e4c-1b2a-469b-b917-3a9c5291b03e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.303370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.304019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.304302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.304578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.305325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:51.305634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.307207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.319553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 409/812] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:51.324936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.337827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c80d5e-d424-41a1-8269-bf25734bb318 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.343039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.343830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.344112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.344384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.355719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.357811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.374856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:51.376396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 404/813] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:51.382289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.392260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f97c5-29ab-4575-b1e7-d5db25213d60 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.397299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.398012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.398293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.398569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.399456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:51.399771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.401739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.427396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 410/814] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:51.432966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.443418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70786fb6-8ef0-4446-b093-9931240a96ad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.451037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.451920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.452208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.452483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.465628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.467460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.493683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:51.494875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 405/815] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:51.500418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.510932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3368bc-3fa4-4c83-9b62-5f3f78af458f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.515864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.516545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.516976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.517290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.518089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:51.518401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.520217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.536092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 411/816] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:51.539060 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.549895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d7be-4b73-4c3d-83ba-0a74ea1629ad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.554981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.555840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.556123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.556445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.564190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.566242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.580929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:51.582487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 406/817] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:51.588718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.599092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea295aa7-384a-4b70-b91a-faeb8247cad5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.604292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.604941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.605291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.605569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.606410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:51.606721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.608619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79559470-b787-427a-b0c3-965f1d991493 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.621985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 412/818] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:51.627570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:51.639088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb84b4c-75c9-4c07-861f-50aded0fd6e2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:51.644012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:51.644886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:51.645239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:51.645517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/4a55309bdafe4b12bd50bc6e944bb10c/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:51.648210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=4a55309bdafe4b12bd50bc6e944bb10c, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:51.650952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d6a49-0b4b-4aaf-a96b-013457678556 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:51.674933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 407/819] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:51 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/4a55309bdafe4b12bd50bc6e944bb10c/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:58:52.040702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6dfb-7779-4be9-aab7-385ba5c1a23e None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.041090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6dfb-7779-4be9-aab7-385ba5c1a23e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.041299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6dfb-7779-4be9-aab7-385ba5c1a23e None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.043365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 413/820] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:52.049049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.049356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.049639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.078062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:52.079273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:52.146904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 408/821] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:52.192726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab6dfb-7779-4be9-aab7-385ba5c1a23e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.211980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab6dfb-7779-4be9-aab7-385ba5c1a23e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.218330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.219186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.219467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.219743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.220587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.222288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.234881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 21 09:58:52.236063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 414/822] 10.222.0.73 () {56 vars in 1150 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:52.242511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.252185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344f65c-b0ac-4a88-b5b9-cfe3d357a655 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.261689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.262429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.262717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.262997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.263732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:52.264038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.265730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.272120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 409/823] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:52.282951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.297214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583be99-119d-4a39-a567-e8f552f149db admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.302605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.303324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.303606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.303882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.304652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:52.304963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.306626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aca1c0-2b5c-474a-a3e3-bbb2222ba68b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.317588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 415/824] 10.222.0.73 () {56 vars in 1145 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:52.323805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.336164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6206-1c46-4f75-853b-fc95e7b5f2d4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.340816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.341586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.341825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.342101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.342902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.343946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:52.343946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:52.343946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:52.344813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd70718-e571-445a-88ba-61a8829b8382 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.395939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 410/825] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:58:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:52.672669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a890-cc64-4e91-9e3f-a9dcf79dcb28 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.672856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a890-cc64-4e91-9e3f-a9dcf79dcb28 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.673251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736a890-cc64-4e91-9e3f-a9dcf79dcb28 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.675089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 416/826] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:52.680643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e854-7f5d-4a38-a0a0-cb54d0e9feea None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.680985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e854-7f5d-4a38-a0a0-cb54d0e9feea None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.681245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4e854-7f5d-4a38-a0a0-cb54d0e9feea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.700838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a1c4e854-7f5d-4a38-a0a0-cb54d0e9feea None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:52.702066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1c4e854-7f5d-4a38-a0a0-cb54d0e9feea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:52.725346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 411/827] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:52.740812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37a37-7782-4f8b-bed9-297cd8b900d3 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.741137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37a37-7782-4f8b-bed9-297cd8b900d3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.741420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37a37-7782-4f8b-bed9-297cd8b900d3 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.743284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 417/828] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:52.749193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.749352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec37a37-7782-4f8b-bed9-297cd8b900d3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.749442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.749442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.763374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec37a37-7782-4f8b-bed9-297cd8b900d3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.768058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.769192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.769638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:52.769893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.770366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.771398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:52.771973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.773971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.791043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:58:52.792418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 418/829] 10.222.0.73 () {56 vars in 1153 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:52.794433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 412/830] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:52.798763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.809697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74415c63-8511-4e0d-9926-9f6b17ede81f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.814591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.815298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.815581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.815864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.816626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:52.816937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.818679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.824342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 419/831] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:52.829965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.831051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.840714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7ac26-0cbd-4ea6-87a5-ca544b5084b1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.842513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60053f0-683b-4d84-9bb4-5e3e43178143 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.847172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.848137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.848646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.849738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.851758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.852489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.853103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.853228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.854089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:52.854494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.856271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.861443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:52.867025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 413/832] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:52.873077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 09:58:52.875029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 420/833] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:52.880944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.898268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf60912-8c5d-4c61-b815-d6b1390b4749 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.915060 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.915762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.916049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.916323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.917132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:52.917442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.919094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.936916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 414/834] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:52.942763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:52.955379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294da1b5-2868-4117-b1a8-83293aa19056 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:52.961085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:52.962294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:52.962769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:52.963314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:52.976088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:52.978429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:52.997290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:52.999240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 421/835] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:53.005235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.016440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb353ba5-cde9-47ff-b077-4edf98ad6504 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.022075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.023095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.023634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.024114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.025122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.025634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.027508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.041916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 415/836] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.047980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.058974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12951a89-27ab-4a15-9a27-5fc5f9141051 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.064141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.065330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.065838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.066338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.077282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.079715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.100255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:58:53.101840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 422/837] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:53.107343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.120893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0d480-834c-4cef-9cfa-387b4e3b098d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.136672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.138081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.138766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.139394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.140954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.141424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.143424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.169920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 416/838] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.175804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.190877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb816173-a7ad-468b-a2d0-1c5a4024f328 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.201678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.202309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.202587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.202856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.216170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.217915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.230666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 423/839] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/auth/tokens => generated 1303 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:58:53.236111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.248202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e0a00-c1c5-4c6b-b2f3-196654215b44 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.258211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.259159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.259442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.259717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.273184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.275024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.300896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-99fa565c-04f1-4b28-b6b8-7b533b5ff66d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:53.307236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 417/840] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:53.308218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.321998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031235d-1898-438e-a78e-bf209433c052 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.335163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.335821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.336096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.336362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.337309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.337723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.340006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.342784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ae95-01fb-4750-b9e3-8f016ccf1723 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.343068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ae95-01fb-4750-b9e3-8f016ccf1723 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.343343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602ae95-01fb-4750-b9e3-8f016ccf1723 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.345452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 418/841] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:53.351010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.351299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.351580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.362011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 424/842] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.372223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.384677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:53.385881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:53.388917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f47251-61d9-4c8b-939a-40d5d5865464 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.395674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.396980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.397283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.397556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.407366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 419/843] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:53 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:53.414129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.416051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.432938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:53.435076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 425/844] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:53.440078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.449994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de686bb-6b81-4b21-b525-7a27bd8468d5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.461438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.462147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.462435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.462690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.463477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.463782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.465630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.470724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.486294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 420/845] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.488504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a79e-dc7f-4ac4-80ac-05453d50915f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.492938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.500204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.501031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.501335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.502649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.503536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.507120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.507883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778edace-f958-4835-896c-a5b57662d7e3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.515284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.516339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.516625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.516898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.520338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=ed9393f0271a41a989524759a68dfc3c) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.520657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.524773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.530972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 21 09:58:53.539065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 426/846] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/services/network => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:53.539315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 421/847] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/role_assignments?user.id=ed9393f0271a41a989524759a68dfc3c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.542090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.552515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432d4a-ee37-4098-9b55-83fbb07a5e39 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.557327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.558096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.558375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.558651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.559410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.559714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.561367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.571470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 427/848] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.572892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.583027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f3d9-304c-4bad-a6c5-7480c07627f9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.588503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.589274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.589552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.589877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.590594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] RBAC: Adding query filter params (type=network) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:53.590942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.592608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bc3f0-63cd-4136-8067-82cfed4d3acb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.603319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 422/849] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:58:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:53.604642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:53.615233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff95ae56-e1be-4b1f-8c09-c320c36f0380 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:53.619985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:53.620686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:53.620968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:53.621314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:53.622061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:53.623135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:53.623135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:58:53.623135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:58:53.624043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f95661-1f63-4d7b-b46c-f8fcdc400cff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:53.662750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 428/850] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:58:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:58:54.470526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c669-86db-46a4-ad63-cc449c0d6d9a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.471148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c669-86db-46a4-ad63-cc449c0d6d9a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.471148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663c669-86db-46a4-ad63-cc449c0d6d9a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.473048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 423/851] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:54.478289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.478753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.478912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.497227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:54.498421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:54.516077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 429/852] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:54.540472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c669-86db-46a4-ad63-cc449c0d6d9a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.553676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663c669-86db-46a4-ad63-cc449c0d6d9a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.558264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.559041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.559324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.559597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.570689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:54.577527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:58:54.578988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 424/853] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:54.584811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.593913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae712a-69f9-49f3-8dac-20dfa2c15100 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.598569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.599768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.600049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.600418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.601205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:54.601513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.603101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.612193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 430/854] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:54.618369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.628238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca0776-4ff5-4d38-adb8-7eef4bb4f392 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.633225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.633999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.634279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.634552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.645429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.647372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.665181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:54.666666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 425/855] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:54.672148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.682732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93910c8f-7f24-4da1-a9d6-353ad329e27f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.687372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.688020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.688306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.688584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.689339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:54.689646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.691220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.703855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 431/856] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:54.709519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.719368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b818d-aade-4c40-a9c7-37bf1dedf0a6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.724602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.725355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.725639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.725911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.734683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.736704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.751918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 21 09:58:54.753457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 426/857] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:54.759354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.769302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254a58-9290-48d2-981d-b109e1147f48 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.773930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.774584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.774864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.775139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.775976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:54.776278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.778111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.796549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 432/858] 10.222.0.73 () {56 vars in 1156 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:54.802724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.812607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203332d-836b-4cf8-a0d4-5842939f48be admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.817374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.818056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.818339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.818613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.827432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.829333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.839788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 427/859] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:58:54.845704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.856649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08a4ef-7c64-42dd-8925-cb6d861dff35 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.861438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.862218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.862498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.862773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.874187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.876075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.893410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:54.894888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 433/860] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:54.900884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.910047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0b79-9fca-4e25-a7a0-5f870b7b9ab3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.915251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.915896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.916176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.916448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.917311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:54.917501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.919050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.931359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 428/861] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:54.936833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.946745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee174ed-c9f3-4fa7-adfe-ff79d28fd7ff admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.951432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.952264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.952545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.952819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:54.960693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:54.962653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:54.976349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:54.977774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 434/862] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:54.983480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:54.993637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136b7b-8dd7-4576-a79d-9f76912fc000 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:54.998241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:54.998890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:54.999174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:54.999447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.000231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:55.000547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.002477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506dded-1be8-4efd-82f3-564cbe447c36 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.015516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 429/863] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:55.021987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:55.032521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987a8d5-b38c-4240-a640-9cc24d97b564 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:55.037707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:55.038395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.038677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.038953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.039834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=4a55309bdafe4b12bd50bc6e944bb10c) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:55.040146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.042055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a8cc-cebe-4feb-a632-5747e655756d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.048861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 435/864] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:55 2022] GET /identity/v3/role_assignments?user.id=4a55309bdafe4b12bd50bc6e944bb10c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:55.230130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3272-cc9e-4219-bae4-8bfc8f0606bc None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.230421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3272-cc9e-4219-bae4-8bfc8f0606bc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.230591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef3272-cc9e-4219-bae4-8bfc8f0606bc None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.232489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 430/865] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:55.238100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.238432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.238650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.256669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:55.258163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:55.270015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 436/866] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:55.289442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef3272-cc9e-4219-bae4-8bfc8f0606bc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:55.302367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef3272-cc9e-4219-bae4-8bfc8f0606bc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:55.307042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:55.307916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.308198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.308469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.309202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.310251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:58:55.310251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:58:55.310251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:58:55.311126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.323763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:58:55.325227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 431/867] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:55.330936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:55.340747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856575d-b084-4802-8317-7de5551bbd64 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:55.345607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:55.346337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.346690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.347035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.347866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:55.348238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.350490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2f6b1-168a-4e2f-b7e5-aae00754c175 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.355695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 437/868] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:55.361086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:55.371958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c7847-2edf-491e-808c-e9ff88a254fd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:55.376733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:55.377662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.378189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.378671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.379629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:55.380153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.382341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5d94-75a5-4a21-85aa-2b6f8a2453cd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.387465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 432/869] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:58:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:55.453623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8000-9d2e-4a05-a520-66042ece43d8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.453955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8000-9d2e-4a05-a520-66042ece43d8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.454183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8000-9d2e-4a05-a520-66042ece43d8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.456397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 438/870] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:55.462161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31709872-7d76-4c37-b701-a96dbe8cd901 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.462448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31709872-7d76-4c37-b701-a96dbe8cd901 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.462728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31709872-7d76-4c37-b701-a96dbe8cd901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.483741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-31709872-7d76-4c37-b701-a96dbe8cd901 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:55.484877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-31709872-7d76-4c37-b701-a96dbe8cd901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:55.497185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 433/871] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:55.518866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8000-9d2e-4a05-a520-66042ece43d8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:55.532235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8000-9d2e-4a05-a520-66042ece43d8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:55.537614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:55.538340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:55.538618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:55.538890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:55.539678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:55.541362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2328808-c996-484c-a4e6-19e4169a243a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:55.565487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 439/872] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:58:55 2022] POST /identity/v3/services => generated 269 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:56.312788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9201953-3f39-4349-9e3a-183ce9596cdf None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.313204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9201953-3f39-4349-9e3a-183ce9596cdf None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.313376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9201953-3f39-4349-9e3a-183ce9596cdf None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.315343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 434/873] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:56.325271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.325557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.325830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.348446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:56.349719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:56.370378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 440/874] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:56.398794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9201953-3f39-4349-9e3a-183ce9596cdf None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.414561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9201953-3f39-4349-9e3a-183ce9596cdf None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.421712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.422815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.423422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.423899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.436733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:56.445231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:58:56.446951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 435/875] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:56.453933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.463190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73e5b9-a182-49f7-841f-abd3b700f729 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.467923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.468820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.469322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.469807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.470761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.471273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.473113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.484576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 441/876] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:58:56.491067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.501642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a41e4-851b-44f3-935b-61786093ea8c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.507359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.508428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.508977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.509459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.522133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.524258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.542625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:56.544328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 436/877] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:56.550067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.561467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779c7fa-0532-498c-a429-c5f3841a0b22 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.567226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.569097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.569525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.569992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.570886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.571397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.573298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.586900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 442/878] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:56.593297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.603786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71ee6-db4b-43c1-81fc-108393aa85fd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.608472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.609521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.609996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.610513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.620360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.622660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.638335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:58:56.640099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 437/879] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:56.648309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.663934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a34ec-040f-43c4-b9f8-3386ef8d717a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.671217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.672210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.672661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.673090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.674124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.674590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.676612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.696656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 443/880] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:56.702563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.714209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fee4e7-7780-4f98-92fc-4f46c67fa76d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.719087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.719932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.720355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.720767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.730162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.732277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.743398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 438/881] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:58:56.749048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.760577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d35ece-b0a6-437f-9ef0-aa2a5f0475c7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.765635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.766868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.767298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.767730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.780584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.783327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.803408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:56.805325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 444/882] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:56.811673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.821527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189757-41b9-4a30-92ca-e7938d594eb8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.826936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.827953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.828688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.829418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.830807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.831264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.834262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.846994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 439/883] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:56.852612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.862726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbc117-e7f6-4c39-b362-b1e8339a3d04 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.867558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.868565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.868988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.869477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.876759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.878943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.893213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:56.894890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 445/884] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:58:56.901307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.911449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1400-f001-4f14-9203-4d68e750e105 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.916214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.917070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.917526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.917979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.918900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.919360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.921517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100cad-dbda-4c25-8e2c-c33109051e1e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.933834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 440/885] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:56.939803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:56.951265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1af9a9-8f21-4b43-8308-d2397b769364 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:56.956583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:56.957468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:56.957950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:56.958949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:56.959961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] RBAC: Adding query filter params (role.id=3f308046957542cb83c53c9d70ad52ad, scope.project.id=395510de8de542388e9d42e99270937b, user.id=ed9393f0271a41a989524759a68dfc3c) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:56.960429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:56.962569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02353-68b3-41b7-9101-7ac8ccd9be97 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:56.968725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 446/886] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:58:56 2022] GET /identity/v3/role_assignments?user.id=ed9393f0271a41a989524759a68dfc3c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3f308046957542cb83c53c9d70ad52ad => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:57.576093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d91-1cae-43b8-ae47-c9b47548c720 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.576650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d91-1cae-43b8-ae47-c9b47548c720 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.576650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc6d91-1cae-43b8-ae47-c9b47548c720 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.578683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 441/887] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:57.584140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.584549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.584721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.602480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:57.603671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:57.611969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 447/888] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:57.635752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc6d91-1cae-43b8-ae47-c9b47548c720 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:57.648605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc6d91-1cae-43b8-ae47-c9b47548c720 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:57.653116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:57.653916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.654199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.654474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.655132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:57.656720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:57.668966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:58:57.670493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 442/889] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:58:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:57.676317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:57.686018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d91498-bf1a-4883-89ea-22c065937929 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:57.690576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:57.691226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.691506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.691781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.692505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:57.692813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:57.694424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ef547-9bc3-40a0-b0f4-69ea2698b454 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:57.699325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 448/890] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:58:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:57.704958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:57.714899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7568d6-379a-4235-8866-8450b7be0271 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:57.719647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:57.720344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.720627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.720955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.721695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:57.722000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:57.723626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f2b28-b147-49ab-bbb6-fbc63425a557 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:57.733410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 443/891] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:58:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:57.815848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fa7e-6cc4-4f54-8c05-31f8f0303349 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.816178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fa7e-6cc4-4f54-8c05-31f8f0303349 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.816386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159fa7e-6cc4-4f54-8c05-31f8f0303349 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.818616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 449/892] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:57.824328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a5ab8-a599-45c0-bd2e-994a071fbb1f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.824621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a5ab8-a599-45c0-bd2e-994a071fbb1f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.824888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a5ab8-a599-45c0-bd2e-994a071fbb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.844626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-679a5ab8-a599-45c0-bd2e-994a071fbb1f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:57.845954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-679a5ab8-a599-45c0-bd2e-994a071fbb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:57.855067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 444/893] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:57.879364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fa7e-6cc4-4f54-8c05-31f8f0303349 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:57.893108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159fa7e-6cc4-4f54-8c05-31f8f0303349 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:57.898516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:57.899283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:57.899562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:57.899895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:57.900637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:57.902362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280040a-5c97-4da0-bcaf-ac4654c85362 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:57.918639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 450/894] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:58:57 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:58:58.000381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda619-b06a-4917-872a-c6e443680357 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.000705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda619-b06a-4917-872a-c6e443680357 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.001089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacda619-b06a-4917-872a-c6e443680357 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.003237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 445/895] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:58.009340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.009615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.009892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.030178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:58.031398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:58.051081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 451/896] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:58 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:58:58.076241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda619-b06a-4917-872a-c6e443680357 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:58.095078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacda619-b06a-4917-872a-c6e443680357 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:58.100100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:58.101008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.101325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.101598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.102316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:58.103986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:58.117180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:58:58.118773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 446/897] 10.222.0.73 () {56 vars in 1153 bytes} [Mon Feb 21 09:58:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:58.128303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:58.137963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0e203-a11b-4d1c-9b5f-413e2eb5fbf6 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:58.142836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:58.143459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.143739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.144014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.144727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:58.145025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:58.147236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:58.152635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 452/898] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:58:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:58.158388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:58.168862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6723e-c5ac-4ec3-a555-2a365a379931 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:58.173588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:58.174324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.174670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.175062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.175840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:58.176211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:58.177910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:58.183456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 447/899] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:58:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:58.189705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:58.200608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbca3a3-c1ad-462e-be6a-f28813b3e5ed admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:58.206038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:58.206893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.207318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.207731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.209291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] RBAC: Adding query filter params (interface=public, service_id=a9cced3bd3a2450e90ba2accdb794c6a, region_id=RegionOne) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:58.209763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:58.211527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d72fae-af96-4aa7-8a7a-0412d3fae1d3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:58.217502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 453/900] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:58:58 2022] GET /identity/v3/endpoints?service_id=a9cced3bd3a2450e90ba2accdb794c6a&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:58.223115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:58.238095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8a6bb-a121-4315-801c-01440cb326a5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:58.243028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:58.243912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:58.244422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:58.244879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:58.245826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:58.247631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8b2d4-33b9-4e0b-97e4-36d2b73231d7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:58.254185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 448/901] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:58:58 2022] GET /identity/v3/services => generated 1268 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:58:59.301820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbdf02-2f6e-4bb4-8657-20d70b563696 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.302876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbdf02-2f6e-4bb4-8657-20d70b563696 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.302983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbdf02-2f6e-4bb4-8657-20d70b563696 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.304785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 454/902] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:58:59.311953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.312384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.312524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.330800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:58:59.331991 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:58:59.345232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 449/903] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:58:59 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:58:59.363374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbdf02-2f6e-4bb4-8657-20d70b563696 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.375985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbdf02-2f6e-4bb4-8657-20d70b563696 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.380461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.381264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.381801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.382072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.392264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:58:59.400100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:58:59.405251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 455/904] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:59.408022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.418142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66faed-8b7a-46de-a7f4-860484c76e99 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.422760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.423428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.423705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.423980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.424732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:59.425035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.426637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.437148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 450/905] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:59.441319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.451445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b0335-1fa5-4b92-bfdd-2aa2bd4b9679 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.455853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.456615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.456891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.457188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.467994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.469825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.487129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:59.492933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 456/906] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:59.494295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.504169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e446-d0c2-40e8-8331-4d20681cb040 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.509107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.509758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.510037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.510311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.511032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:59.511335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.512904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.530068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 451/907] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:59.531435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.541660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3392a-34ee-42c7-9e15-5e302d750e50 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.546192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.546976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.547255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.547528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.555263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.557264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.571939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:58:59.577158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 457/908] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:59.579110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.588967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962446c5-4438-42e5-9d85-1ff2e2803b4a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.593569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.594222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.594500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.594775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.595653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:59.595908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.597741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.620374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 452/909] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:59.621751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.632321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f880e7c-9128-46c6-a0c7-ce4ec8158d83 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.636890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.637687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.637960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.638229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.648480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.650315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.666778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:58:59.672448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 458/910] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:59.673816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.684284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea356113-f02a-4747-8df4-093065dd4cf8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.688947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.689627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.689905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.690179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.690899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:59.691204 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.693377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.709162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 453/911] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:59.710909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.721038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba8e52-400e-49e9-9ea7-45f1e326f945 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.725955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.726767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.727046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.727320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.735252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.737254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.751904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:58:59.757158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 459/912] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:58:59.760082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.769995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b7f3f-9725-4e97-b486-39e122796071 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.774711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.775361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.775642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.775913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.776699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:58:59.777004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.778838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd2333-73a8-4bd2-b74a-50391a5c2e61 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.796683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 454/913] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:58:59.798013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:58:59.808831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f2222-d746-4ba5-b9b1-7784737f89e9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:58:59.813434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:58:59.814288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:58:59.814566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:58:59.814837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/ed9393f0271a41a989524759a68dfc3c/roles/3f308046957542cb83c53c9d70ad52ad` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:58:59.817087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=ed9393f0271a41a989524759a68dfc3c, role_id=3f308046957542cb83c53c9d70ad52ad)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:58:59.819729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121bd81-ba58-4df1-83b5-43d0adc8fdfd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:58:59.841250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 460/914] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:58:59 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/ed9393f0271a41a989524759a68dfc3c/roles/3f308046957542cb83c53c9d70ad52ad => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:59:00.094778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace635-67be-4957-a7a2-54bba333b1bb None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.095065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace635-67be-4957-a7a2-54bba333b1bb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.095337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ace635-67be-4957-a7a2-54bba333b1bb None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.097260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 455/915] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:00.103245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a7e2-20a6-40d5-88db-e0531c23cd6d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.103530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a7e2-20a6-40d5-88db-e0531c23cd6d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.103799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a7e2-20a6-40d5-88db-e0531c23cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.122181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-0bd9a7e2-20a6-40d5-88db-e0531c23cd6d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:00.123358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0bd9a7e2-20a6-40d5-88db-e0531c23cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:00.184083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 461/916] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:00.206486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ace635-67be-4957-a7a2-54bba333b1bb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.219609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ace635-67be-4957-a7a2-54bba333b1bb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.224928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.225851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.226324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.226785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.227687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.229480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fc1d3-1e34-43df-92af-ca5e133eddfe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.245647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 456/917] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:00 2022] POST /identity/v3/services => generated 241 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:00.433375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af935c4f-61c8-456f-8bbf-634212a7e6f3 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.433861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af935c4f-61c8-456f-8bbf-634212a7e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.434116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af935c4f-61c8-456f-8bbf-634212a7e6f3 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.436232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 462/918] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:00.441816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.442255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.442983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.460753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:00.461984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:00.478352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 457/919] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:00.502818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af935c4f-61c8-456f-8bbf-634212a7e6f3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.515874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af935c4f-61c8-456f-8bbf-634212a7e6f3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.520375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.521307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.521651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.521990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.522711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.524458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.535900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:59:00.537926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 463/920] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:00.543787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.553636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabfdf1-56d7-47c8-aa12-07905e040f34 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.558410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.559198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.559553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.559903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.560685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:00.561081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.562743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.568155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 458/921] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:00.573470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.583718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea24ca-730d-498b-bb1c-96000c546d73 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.588763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.589698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.590222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.590685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.591681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:00.592174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.594068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.600740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 464/922] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:00.606778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.617945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39266bcd-65b3-44d6-8fc7-bd679da0bb59 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.623003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.623936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.624410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.624899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.625966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] RBAC: Adding query filter params (interface=public, service_id=6f4b36816df445efb1682cd20897a366, region_id=RegionOne) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:00.626522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.628401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7e097-f140-4ca4-9d16-e2ad648d512a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.634895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 459/923] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/endpoints?service_id=6f4b36816df445efb1682cd20897a366&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:00.640476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.650737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300aed0-9f6c-4a39-86bf-93d6fb51fdb2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.653481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca5ab-93bd-442a-a86b-46b40c2e8e8c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.653771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca5ab-93bd-442a-a86b-46b40c2e8e8c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.654047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca5ab-93bd-442a-a86b-46b40c2e8e8c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.656077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 460/924] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:00.656776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.657807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.658415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.658934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.659901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.660917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b48a4-3430-41d3-87af-b90add34469f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.661795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b48a4-3430-41d3-87af-b90add34469f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.662076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b48a4-3430-41d3-87af-b90add34469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.663074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.671356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 465/925] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:59:00.684432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-560b48a4-3430-41d3-87af-b90add34469f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:00.685662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-560b48a4-3430-41d3-87af-b90add34469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:00.694569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 461/926] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:00 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:00.718487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.730325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97175160-df77-48d3-9e67-721d18c7dfb9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.736416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.737647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.738025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.738457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.739203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.742277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.755017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 21 09:59:00.756835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 466/927] 10.222.0.73 () {56 vars in 1153 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:00.762476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b48a4-3430-41d3-87af-b90add34469f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.772273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b48a4-3430-41d3-87af-b90add34469f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.777364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.778436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.779263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.779734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.780701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:00.781238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.783049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.789415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 462/928] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:00.795341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.807245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acaa3c-4534-4c00-83af-1d976cf76383 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.812336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.813372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.813915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.814431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.815334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:00.815844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.817801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d247c71-4b13-4636-a37a-b24dd2788534 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.824113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 467/929] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:00.830185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:00.840834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c4f0b-cc89-4e7f-9be1-9e2881460a13 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:00.846037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:00.847058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:00.847591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:00.848055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:00.849596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:00.851516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f08c3-82d7-42c0-b503-4d790ebb692c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:00.879860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 463/930] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:02.221283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378814-dd60-4734-9c41-fecb5730f6bb None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.221794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378814-dd60-4734-9c41-fecb5730f6bb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.221870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8378814-dd60-4734-9c41-fecb5730f6bb None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.224385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 468/931] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:02.229827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.230218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.230395 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.248599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:02.249793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:02.270981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 464/932] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:02 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:02.295665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378814-dd60-4734-9c41-fecb5730f6bb None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.308452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8378814-dd60-4734-9c41-fecb5730f6bb None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.312870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.313756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.314032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.314303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.324463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:02.331665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:59:02.337157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 469/933] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.339054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.348190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481a39f-28c1-46ce-9451-d16175154d61 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.353334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.354036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.354317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.354585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.355331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.355629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.357219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.366764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 465/934] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.372641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.384219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e36ac6-908b-4921-bf87-4c62929bbae9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.390395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.391632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.392209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.392682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.406813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.409135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.428123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:02.434460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 470/935] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.436044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.447345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011b261-75e1-4884-a813-66e038bf2967 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.452247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.453169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.453673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.454194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.455110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.455633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.457500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.476444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 466/936] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.478074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.488032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323e32b-522f-479b-94af-6d3d57980490 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.492928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.494021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.494587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.495132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.503185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.505519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.521085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 21 09:59:02.522881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 471/937] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.528784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.539125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b61f0-2206-4f60-ae83-45cebf0dee4c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.544015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.544869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.545348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.545791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.546805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.547266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.549304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.567311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 467/938] 10.222.0.73 () {56 vars in 1170 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.573122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.583656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0412122-e2fd-453b-a683-f7ebb946845b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.588499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.589386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.589870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.590282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.599839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.601824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.611578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 472/939] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:02.617439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.627516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bcff-e426-430f-90d3-f65e4e0f8d53 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.632785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.633780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.634268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.634719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.646320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.648289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.666147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:02.667877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 468/940] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.673638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.686045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d226914-9769-4168-9035-f374f47bd8c7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.690864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.691676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.692119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.693158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.694118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.694565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.696300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.710243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 473/941] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.716175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.727078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0920999-7fd4-4b66-a60f-647593eacca6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.732292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.733433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.733883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.734297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.742928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.745125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.762979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-67f935b6-12a6-4cd6-b524-3932f57b06e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:59:02.764821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 469/942] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.771750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.780879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587dff-330f-4a1e-a24e-01a252ca27ad None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.781221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587dff-330f-4a1e-a24e-01a252ca27ad None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.781496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f587dff-330f-4a1e-a24e-01a252ca27ad None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.783611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 470/943] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:02.783910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a533bdc-9c9f-470e-91fd-a8c81a5ad76c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.789301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.789559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.789685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.789858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.791069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.791519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.791931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.792998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.793508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.795611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.809653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 474/944] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.814983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:02.814983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:02.816283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.822232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 471/945] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:02 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:02.829157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42095dcb-28c1-46ed-8751-260c54332a20 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.834152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.835136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.835684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.836138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.837210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] RBAC: Adding query filter params (role.id=3f308046957542cb83c53c9d70ad52ad, scope.project.id=395510de8de542388e9d42e99270937b, user.id=ed9393f0271a41a989524759a68dfc3c) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.837695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.839902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.845784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.847115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 475/946] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/role_assignments?user.id=ed9393f0271a41a989524759a68dfc3c&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3f308046957542cb83c53c9d70ad52ad => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.855674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ef57f-90a9-49b7-ba5b-82be9f827f7f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.860434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.861393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.861670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.861939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.862655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.864983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.877388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:59:02.878953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 472/947] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:02.885381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.896095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7202d-62bf-43e2-b68c-9c5e3e261726 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.901245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.902216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.902718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.903208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.904134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.904646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.906554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.913289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 476/948] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.921550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.932852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c51914-b25a-4c85-9b08-4f8a067e8a4f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.938353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.939095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.939375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.939648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.940440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.940747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.942512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.948619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 473/949] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.954571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:02.964780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adea4d-a6e9-4a08-83e1-63a4f17d8085 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:02.970100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:02.971129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:02.971640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:02.972139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:02.973193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] RBAC: Adding query filter params (interface=public, service_id=e3fa5953cbaf45588877b0b0adda6bef, region_id=RegionOne) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:02.974250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:02.976105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d377eb-88d1-4886-b5c8-10cf089e17b5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:02.982973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 477/950] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/endpoints?service_id=e3fa5953cbaf45588877b0b0adda6bef&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:02.991132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.001490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e4ffc-59b8-4cd7-a39c-fe3f7b0e0a1f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.007183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.007949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.008228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.008499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.009276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.010932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fef16-ac9c-4599-8058-ea0bbf1c3c0d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.017920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 474/951] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:59:02 2022] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:59:03.107381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10757607-c09d-4a89-935d-7d01695f3065 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.107670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10757607-c09d-4a89-935d-7d01695f3065 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.107855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10757607-c09d-4a89-935d-7d01695f3065 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.110118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 478/952] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:59:03.116567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.116932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.117156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.136840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:03.138101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:03.147209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 475/953] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:03 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:03.171785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10757607-c09d-4a89-935d-7d01695f3065 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.184670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10757607-c09d-4a89-935d-7d01695f3065 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.189503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.190319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.190601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.190876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.191536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.194021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.205804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 21 09:59:03.207223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 479/954] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:03.213488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.222746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d38f6-accf-419d-9945-6276ec1175ec None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.229461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.230121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.230738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.230738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.231360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:03.231668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.233279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.238315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 476/955] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:03.243918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.255023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b668e0-2809-4dde-9370-6acae56a8b2d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.259969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.260617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.260895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.261196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.261901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:03.262201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.263822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35c1f7-1281-49eb-a49d-0f72ea92e735 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.269562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 480/956] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:03.278362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.288986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29249ac-81ce-4b70-a239-5b5e5cccae3c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.294460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.295115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.295478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.295794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.296557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.298215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.303255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c292-5faa-437c-b7a1-a69d76ea6fcc None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.303780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c292-5faa-437c-b7a1-a69d76ea6fcc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.304054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6c292-5faa-437c-b7a1-a69d76ea6fcc None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.306879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 481/957] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:03.314169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.314496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.314741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.324270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 477/958] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:03.336698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:03.338761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:03.358727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 482/959] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:03 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:03.382940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.393859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b21ccd-1210-4d74-8ff0-a304011c802d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.398655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.399580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.399930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.400276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.401018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.402757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.414782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:59:03.421244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 478/960] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:03.422825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.432673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3687c-0655-4911-9e13-a55fdf88ea73 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.437709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.438383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.438657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.439113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.439829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:03.440132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.441840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ff7c2-af9e-4fff-b10d-bee2c438eec9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.447941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 483/961] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:03.453529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:03.463952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a920fc5-b651-458a-a5b5-87c3a442e69d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:03.468607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:03.469309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:03.469589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:03.469858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:03.470568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:03.470867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:03.472468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411239ad-555b-4b2e-925d-f9ec3605b367 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:03.478129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 479/962] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:05.279627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8182-41c5-44c7-ab1c-ae0c544cea6b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.280127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8182-41c5-44c7-ab1c-ae0c544cea6b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.280201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd8182-41c5-44c7-ab1c-ae0c544cea6b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.282212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 484/963] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:05.288072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.288485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.288654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.308367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:05.309641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:05.318281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 480/964] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:05.339986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8182-41c5-44c7-ab1c-ae0c544cea6b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.352955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd8182-41c5-44c7-ab1c-ae0c544cea6b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.357384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.358149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.358428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.358691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] PATH_INFO: `/v3/services/image` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.359336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.360966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.372368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:59:05.373861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 485/965] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:05.379664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.388939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e232ed-4ad1-41c2-b541-485783440ac4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.393549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.394197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.394478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.394750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.395985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:05.396290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.397883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfde97-28f3-407e-93e3-36790929ef2c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.402759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 481/966] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:05.408285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.418521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7497e1-a247-4c40-94a7-55b9dde7ec8f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.423149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.423802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.424083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.424356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.425076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:05.425387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.427010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164ae6-4aaf-4e6f-a056-8db499654ac4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.434825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff098a-4518-41c4-85ae-7f858acdc37f None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.435397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff098a-4518-41c4-85ae-7f858acdc37f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.435868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff098a-4518-41c4-85ae-7f858acdc37f None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.437153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 486/967] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:05.438524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 482/968] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:59:05.444583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.445263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.445738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.465515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:05.467164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:05.476570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 487/969] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:05.500828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff098a-4518-41c4-85ae-7f858acdc37f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.516491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff098a-4518-41c4-85ae-7f858acdc37f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.521956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.523138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.523639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.524187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.525048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.526942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.540009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:59:05.542009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 483/970] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:05.548174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.557929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a70bc-8931-4460-97c4-54a46a03067c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.563008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.563999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.564478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.564944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.565881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:05.566406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.568247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.574228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 488/971] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:05.580386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.591432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e9fdd-296a-45e6-8c24-b8cb57761b1c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.596585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.597598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.598084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.599118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.600032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:05.600557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.602397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be955a2-6cc2-4b90-b7ba-a6b8e0bbe249 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.608803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 484/972] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:05.614785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.624998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44cb41-574e-4165-9590-40e9030e334b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.630907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.631891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.632250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.632575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.633418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.635062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035deffe-5b3c-4ac5-a033-ae5c3fee0361 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.655686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 489/973] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:59:05.686531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd9c1-6bab-4fd4-9d91-bca4aff9ed2c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.686818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd9c1-6bab-4fd4-9d91-bca4aff9ed2c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.687098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fd9c1-6bab-4fd4-9d91-bca4aff9ed2c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.689330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 485/974] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:05.695131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.695415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.695699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.714945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:05.716146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:05.734728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 490/975] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:05.759763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd9c1-6bab-4fd4-9d91-bca4aff9ed2c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.773887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fd9c1-6bab-4fd4-9d91-bca4aff9ed2c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.778599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.779268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.779551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.779824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.780544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.782453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.783844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.common [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 09:59:05.804148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.sql.core [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 21 09:59:05.804148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 21 09:59:05.804148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [parameters: {'id': 'a8376e69d8b44fbeacb78aaa34973fe3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 21 09:59:05.804148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79432) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:59:05.811338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-a97c7858-435f-4958-adbd-6cafa6ac6329 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a8376e69d8b44fbeacb78aaa34973fe3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a8376e69d8b44fbeacb78aaa34973fe3. Feb 21 09:59:05.813278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 486/976] 10.222.0.73 () {60 vars in 1161 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/projects => generated 262 bytes in 54 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:05.820400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.831604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf45792-342c-4406-9a90-81ce8c32c457 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.837126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.838029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.838314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.838595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.847532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.851546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.868503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:59:05.870064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 491/977] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:05.873476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cad5-3eab-42b4-a642-18f1d7ef7df7 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.873772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cad5-3eab-42b4-a642-18f1d7ef7df7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.874050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cad5-3eab-42b4-a642-18f1d7ef7df7 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.875731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.878805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 487/978] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:05.884911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e431-a926-49aa-9597-26ffc6bf3507 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.885507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e431-a926-49aa-9597-26ffc6bf3507 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.885788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362e431-a926-49aa-9597-26ffc6bf3507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.887183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cfd64-e164-406e-8108-1bc0a56996ab admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.892295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.892943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.893248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.893523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.894382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:05.894777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.897440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.906746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2362e431-a926-49aa-9597-26ffc6bf3507 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:05.908661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2362e431-a926-49aa-9597-26ffc6bf3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:05.916366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 492/979] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:05.918179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 488/980] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:05.941962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:05.953737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89f8f7-10ec-42c4-92e5-738f9a6fbf35 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:05.959826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:05.960867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:05.961457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:05.961929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:05.962916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:05.964766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edde91-2d17-47e0-b05c-e68c6d29d811 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:05.982537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 493/981] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:05 2022] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:07.810958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e658e-47d4-4a12-857b-6e35bc7fc12a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:07.811500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e658e-47d4-4a12-857b-6e35bc7fc12a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:07.811500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e658e-47d4-4a12-857b-6e35bc7fc12a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:07.813545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 489/982] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:07.819005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664b92-2c5d-4e25-a4d8-23039d07e334 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:07.819401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664b92-2c5d-4e25-a4d8-23039d07e334 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:07.819568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94664b92-2c5d-4e25-a4d8-23039d07e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:07.837792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-94664b92-2c5d-4e25-a4d8-23039d07e334 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:07.838992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-94664b92-2c5d-4e25-a4d8-23039d07e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:07.861167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 494/983] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:07.881622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e658e-47d4-4a12-857b-6e35bc7fc12a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:07.893949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e658e-47d4-4a12-857b-6e35bc7fc12a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:07.898924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:07.899574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:07.899857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:07.900133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:07.900864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:07.902683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95586-6162-4b5c-a7b5-00f49a1030dc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:07.925222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 490/984] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:07 2022] POST /identity/v3/services => generated 242 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:08.101772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e03a-0419-4f50-bbad-4bd039871ae7 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.102068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e03a-0419-4f50-bbad-4bd039871ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.102329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e03a-0419-4f50-bbad-4bd039871ae7 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.104400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 495/985] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:08.109935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.110227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.110510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.130876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:08.132638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:08.154925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 491/986] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:08.178042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e03a-0419-4f50-bbad-4bd039871ae7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.190743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e03a-0419-4f50-bbad-4bd039871ae7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.195931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.196856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.197240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.197586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.198311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.199982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.212960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:59:08.214518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 496/987] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:08.220546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.229665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c1aa9-89e5-4e3b-a340-f1248313060d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.234381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.235034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.235316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.235594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.236304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.236611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.238231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.243779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 492/988] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:08.249449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.260096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df427cb4-a184-4158-84b0-10370469e75a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.264859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.265591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.265874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.266153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.266850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.267154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.268780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.274878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 497/989] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:08.280733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.291786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b45a-056c-45a9-83e6-f31f098d2f9d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.297091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.297760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.298040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.298374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.299166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] RBAC: Adding query filter params (interface=admin, service_id=e3fa5953cbaf45588877b0b0adda6bef, region_id=RegionOne) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.299520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.301316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379880-75de-4fdd-9bb8-61bf096aeee3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.307682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 493/990] 10.222.0.73 () {56 vars in 1270 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/endpoints?service_id=e3fa5953cbaf45588877b0b0adda6bef&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:08.313239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.323364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c63020-f5a5-43de-a31e-ff78c6e2c6d7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.328210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.328871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.329234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.329518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.330196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.331879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdadfa9-d1df-48a1-b1af-cbb6c982be64 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.339244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 498/991] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:59:08.360978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e31e31-47ce-4b66-911d-176f74d679d2 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.361288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e31e31-47ce-4b66-911d-176f74d679d2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.361481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e31e31-47ce-4b66-911d-176f74d679d2 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.363628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 494/992] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:08.369987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.370320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.370530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.380648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fa39-03b7-4c9c-b0d4-1a1ec6c104d1 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.380963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fa39-03b7-4c9c-b0d4-1a1ec6c104d1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.381486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772fa39-03b7-4c9c-b0d4-1a1ec6c104d1 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.383615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 495/993] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 09:59:08.389186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.389455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.389726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.391160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:08.392348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:08.401572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 499/994] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:08.409480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:08.410751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:08.419863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 496/995] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:08.428359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.438087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a06d19-c0c8-487b-acc1-deeba09fd673 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.443453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.444112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.444395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.444665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.445310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.445630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.447241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.448560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.common [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 21 09:59:08.454817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55680097-8ef8-4cef-a8cb-788704bb5cdb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.460629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.461661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.461945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.462218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.462613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.sql.core [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 21 09:59:08.462613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 21 09:59:08.462613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [parameters: {'user_id': '5aa12d940eba4b608fbd88de67287d69', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 21 09:59:08.462613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79433) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 21 09:59:08.463180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.464626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.477239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:59:08.477822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 21 09:59:08.478820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 497/996] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:59:08.479473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 500/997] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 09:59:08 2022] POST /identity/v3/users => generated 160 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:08.485174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.485688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.495618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a62fd-5e81-4433-bc07-a12c292f0c39 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.498468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b4151-b07b-4b35-ad35-016ac9ca42e1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.500525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.501291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.501574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.501848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.502757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.503061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.503705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.504695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.504853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.505158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.505529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.510863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 498/998] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:08.516918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.519120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.521946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.528666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb9f4-c106-434a-9be8-490f5a58d7eb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.533477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.534178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.534456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.534727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.535477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.535780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.536652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 21 09:59:08.537867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 501/999] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:08.539287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.543448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.544740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 499/1000] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:08.551058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.554504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a2af-42a3-4c60-8397-d1480556e42e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.560855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.561325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf189f50-1d42-4412-af9d-641edbe45275 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.561540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.561816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.562086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.562884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.563186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.565883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12aac2d-6580-46cc-a154-6e937a6d96bb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.567006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.567671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.567956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.568233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.569008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] RBAC: Adding query filter params (interface=public, service_id=f9954a562c644600a6e46243e67464be, region_id=RegionOne) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:08.569374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.570938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.576062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 500/1001] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/endpoints?service_id=f9954a562c644600a6e46243e67464be&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:08.583772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:08.593811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294adcbe-e9f8-495d-8cbb-76654acd6a92 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:08.599183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:08.599832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:08.600121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:08.600401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:08.601104 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:08.602694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ef1a3-0ff6-4662-8b13-dd1a454cb020 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:08.610055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 501/1002] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:59:08.617543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 502/1003] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Feb 21 09:59:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.351300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b4c0-dd0d-4784-84bd-4b690ffbb004 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.351803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b4c0-dd0d-4784-84bd-4b690ffbb004 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.351803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b4c0-dd0d-4784-84bd-4b690ffbb004 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.353806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 502/1004] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:10.359514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.360060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.360196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.498912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:10.500422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:10.509020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 503/1005] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:10 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:10.531999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b4c0-dd0d-4784-84bd-4b690ffbb004 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.544647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b4c0-dd0d-4784-84bd-4b690ffbb004 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.549097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.549929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.550282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.550633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.551380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.553765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.564500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:59:10.569085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 503/1006] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:10.571649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.580456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b22fd-5800-4b71-b97f-0f3ebc369b98 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.584940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.585642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.585918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.586184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.586899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] RBAC: Adding query filter params (name=image) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:10.587198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.588827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.594741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 504/1007] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.600907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.611680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565822cc-70b9-4a69-9ffa-748b291400a3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.617007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.617814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.618101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.618374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.619084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:10.619389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.621078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.626486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 504/1008] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.632706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.642332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff2019-85f2-409b-afd7-e7a083123abf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.647341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.648069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.648412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.648747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.649567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] RBAC: Adding query filter params (interface=public, service_id=e7923ab8f7a44af58bca9b58bb96f9f8, region_id=RegionOne) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:10.649873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.651443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dcb1c-236e-4aeb-824b-a41127ec5818 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.656813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 505/1009] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/endpoints?service_id=e7923ab8f7a44af58bca9b58bb96f9f8&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.662567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.671957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e80fd1-c2e3-4309-92d8-448fe20d69b9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.676331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.677015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.677328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.677598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.678265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.679804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecab1f2-7ea2-429f-8b13-6599a354414a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.686368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 505/1010] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services => generated 1957 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 09:59:10.700647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852928-7ee1-4ba4-8ce2-8c4e889eeec1 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.700968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852928-7ee1-4ba4-8ce2-8c4e889eeec1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.701233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a852928-7ee1-4ba4-8ce2-8c4e889eeec1 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.703309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 506/1011] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:10.709608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.709946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.710175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.729426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:10.730643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:10.738786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 506/1012] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:10 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:10.762646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852928-7ee1-4ba4-8ce2-8c4e889eeec1 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.775666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a852928-7ee1-4ba4-8ce2-8c4e889eeec1 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.780231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.781047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.781352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.781624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.782289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.783945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.796344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 21 09:59:10.797800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 507/1013] 10.222.0.73 () {56 vars in 1147 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:10.803691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.812991 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53047ede-d9b5-459d-8ab6-90c70a72bd9e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.817669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.818352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.818637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.818912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.819642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:10.819955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.821609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.827201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 507/1014] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.833453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.843657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288f88e-ceb9-465c-9437-bc3c65db38f9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.848964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.850051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.850454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.850848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.851728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:10.852027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.855435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e60c19-429d-4117-84b8-c8c40b2ceb9f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.861804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 508/1015] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Feb 21 09:59:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:10.867713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:10.877581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374583ea-3897-4a19-9dba-6440f17ad072 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:10.882656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:10.883385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.883719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.883948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.884676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:10.886297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9f913-30b7-4cb1-81de-0ba69155fc99 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:10.903854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 508/1016] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:10.966056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f677e7-e792-4f99-a380-42e4f2eb00d6 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.966437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f677e7-e792-4f99-a380-42e4f2eb00d6 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.966606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f677e7-e792-4f99-a380-42e4f2eb00d6 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.968663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 509/1017] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:10.975016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:10.975302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:10.975580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:10.995074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:10.996357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:11.014442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 509/1018] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:10 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:11.043299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f677e7-e792-4f99-a380-42e4f2eb00d6 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:11.056373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f677e7-e792-4f99-a380-42e4f2eb00d6 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:11.060943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:11.061771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:11.062051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:11.062329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:11.062987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:11.064588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:11.076719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 21 09:59:11.078200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 510/1019] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:11.084543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:11.095569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7d2e3-7842-44b9-9c21-284df8dcef55 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:11.100698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:11.101387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:11.101670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:11.101947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:11.102648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:11.102954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:11.104546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:11.110098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 510/1020] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:11.116329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:11.128728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e390e-5b35-47d6-acb7-3f79a8d99ce7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:11.133715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:11.134362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:11.134641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:11.134912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:11.135625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:11.136009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:11.137644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23e8cc-89fe-40d7-b4b5-d3c3e1daf38b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:11.143172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 511/1021] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Feb 21 09:59:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:11.148971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:11.158812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d613f-f300-4cf4-96f3-079d236259a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:11.164086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:11.164731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:11.165082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:11.165372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:11.166169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:11.167791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677291f-fc23-48c7-8884-6e692fa9f71f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:11.190633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 511/1022] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:12.992532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fdbf2-6fc8-44b6-8ccf-770c6dff4183 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:12.993247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fdbf2-6fc8-44b6-8ccf-770c6dff4183 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:12.993247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fdbf2-6fc8-44b6-8ccf-770c6dff4183 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:12.994986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 512/1023] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:13.000009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.000402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.000562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.018626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:13.019793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:13.036324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 512/1024] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:12 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:13.059137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fdbf2-6fc8-44b6-8ccf-770c6dff4183 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.071948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fdbf2-6fc8-44b6-8ccf-770c6dff4183 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.076382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.077252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.077531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.077798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.078439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.080008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.091168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 21 09:59:13.092355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 513/1025] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:59:13.099148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.107922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdee09-b6e2-4673-b51a-a60bb317e93e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.112352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.112999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.113303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.113571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.114811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:13.115110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.116677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.121823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 513/1026] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.127341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.137858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb194a-4fca-4cb2-a3a4-dd01d310c458 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.142293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.142932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.143206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.143474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.144168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:13.144465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.146069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340aec7-858a-44a6-861d-5072afb90689 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.150965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 514/1027] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.156338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.165817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8e7ee-e93a-4cde-91b7-0e411cbeca64 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.170232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.170869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.171149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.171421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.172143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.173775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24f0e5-653c-411d-99da-552402c1efb9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.194033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 514/1028] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 09:59:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:13.228725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58f6c-6185-4740-84a2-0fa7ec9045d9 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.229426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58f6c-6185-4740-84a2-0fa7ec9045d9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.229912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db58f6c-6185-4740-84a2-0fa7ec9045d9 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.232493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 515/1029] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:13.238226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.238570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.239297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.258851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:13.260063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:13.279045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 515/1030] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:13.305410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58f6c-6185-4740-84a2-0fa7ec9045d9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.319045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db58f6c-6185-4740-84a2-0fa7ec9045d9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.324128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.325323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.325833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.326336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.327856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.329949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8132c210-69a2-4279-a15e-fe8e209c8819 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.332241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 516/1031] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.337883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.347162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e748e6-20b3-4012-bc38-632c386c3302 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.352258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.352927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.353235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.353507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.354218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.356117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40c006-f007-4b08-b93e-b9608c65c5fa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.384073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 516/1032] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:13 2022] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:13.599839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb579-eb84-4670-97f4-0b8ac79935be None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.600177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb579-eb84-4670-97f4-0b8ac79935be None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.600301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdb579-eb84-4670-97f4-0b8ac79935be None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.602114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 517/1033] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:13.607466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.607754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.608029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.626659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:13.627878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:13.684189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 517/1034] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:13.708259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdb579-eb84-4670-97f4-0b8ac79935be None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.720113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdb579-eb84-4670-97f4-0b8ac79935be None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.725044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.725861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.726137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.726462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.736946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:13.744241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:59:13.745615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 518/1035] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:13.751291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.760588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c36a1-5315-4ff1-aaec-b3a3ab951c89 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.765120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.765784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.766120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.766394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.767138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:13.767466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.769009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.777862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 518/1036] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.783226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.793531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae29cef-1763-4c1d-93ea-9cf6805a6b97 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.798129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.798891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.799160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.799427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.809558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.811371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.831795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:13.832115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 519/1037] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:59:13.838773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.849628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d31952-e261-4582-91dd-02162a28b7d3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.854591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.855499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.855982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.856467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.857408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:13.857914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.859868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.876727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 519/1038] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.878121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.888549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a2f27-70d4-4632-8831-ca9d5c0f032a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.893374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.894398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.894885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.895878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.903893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.906183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.921432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:59:13.927771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 520/1039] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:13.929003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.939502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc00-2060-4b1c-aa4a-a8bc18842519 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.944342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.945271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.945755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.946224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:13.947255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:13.947794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:13.949854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:13.977374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 520/1040] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:13.979160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:13.989444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316f92-8e62-43a4-a40e-0b8ed9bdc3ea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:13.994290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:13.995599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:13.996074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:13.996542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.005241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.007494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.023017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:14.033696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1193bf2-3aef-4ab3-a2b1-ec1ebd5cfb46 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:14.034272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 521/1041] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:14.039798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:14.040914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:14.041427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:14.041927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.052945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.055126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.073021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:14.074497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 521/1042] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:14.079897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:14.094556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bfcd4-7438-4308-bbbb-a8fd2b32cbe6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:14.099511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:14.100423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:14.100939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:14.101487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.102406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:14.102924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.104761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.121403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 522/1043] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:14.126192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:14.138014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c3ebe-b96e-40a0-b5ec-9468d97be052 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:14.148926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:14.150676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:14.150954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:14.151221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.160092 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.162450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.175977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:59:14.183395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:14.194580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 522/1044] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:14.195079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b260e-cf42-4c0d-b0a9-4a0b9f93c359 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:14.200088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:14.201017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:14.201653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:14.202143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.203191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:14.203765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.205963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c83796-4b18-476a-9187-7dc8f4628d4a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.224292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 523/1045] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:14.226070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:14.236567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42aa7-94d1-47c3-8afb-a493333cfbfd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:14.241032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:14.241700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:14.241979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:14.242253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:14.243068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] RBAC: Adding query filter params (role.id=3f308046957542cb83c53c9d70ad52ad, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:14.243375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:14.245344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fd8ab-3e35-4767-bdb4-5b89004aa3fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:14.250850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 523/1046] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:14 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3f308046957542cb83c53c9d70ad52ad => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:15.559041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f09ba3-fe36-49a4-affc-c5b8408bc289 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.559581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f09ba3-fe36-49a4-affc-c5b8408bc289 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.559581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f09ba3-fe36-49a4-affc-c5b8408bc289 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.561529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 524/1047] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:15.566645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.567086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.567250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.584571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:15.585780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:15.593515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 524/1048] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:15.616820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f09ba3-fe36-49a4-affc-c5b8408bc289 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:15.628782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f09ba3-fe36-49a4-affc-c5b8408bc289 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:15.633486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86430615-981c-442f-b2ad-576420007387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:15.634112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430615-981c-442f-b2ad-576420007387 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.634390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430615-981c-442f-b2ad-576420007387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.634659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430615-981c-442f-b2ad-576420007387 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.642578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86430615-981c-442f-b2ad-576420007387 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:15.644303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86430615-981c-442f-b2ad-576420007387 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:15.653241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 525/1049] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:15 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:15.658781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:15.668391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f412a-6f94-478d-9dc8-3d564af49e0c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:15.672922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:15.673799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.674147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.674485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.675731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:15.678039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf23325-5eb4-48b2-acd8-9156a75f710b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:15.679758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 525/1050] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:15.738264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccdc-68a6-4d50-b176-1cfdd1cf1b61 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.738583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccdc-68a6-4d50-b176-1cfdd1cf1b61 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.739384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bccdc-68a6-4d50-b176-1cfdd1cf1b61 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.741613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 526/1051] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:15.747215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.747502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.747915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.766912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:15.768177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:15.776371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 526/1052] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:15.802744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bccdc-68a6-4d50-b176-1cfdd1cf1b61 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:15.815404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bccdc-68a6-4d50-b176-1cfdd1cf1b61 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:15.819971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:15.820761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.821036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.821334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.822514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:15.824187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa37d8-f919-4728-af50-9bb0efdf1df7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:15.826081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 527/1053] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:15.831630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:15.841097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bd2a4-1230-4d71-9aa0-c01c05e4f4ec None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:15.845936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:15.846615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:15.846897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:15.847170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:15.847892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:15.850385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7867eb2-7cda-4d96-a210-10bd93b6609c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:15.872092 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 527/1054] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:59:15 2022] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:16.534033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d6849-1dfa-491f-950a-deb8f3e7442f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.534320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d6849-1dfa-491f-950a-deb8f3e7442f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.534593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d6849-1dfa-491f-950a-deb8f3e7442f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.536549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 528/1055] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:16.541896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.542184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.542457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.559551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:16.560712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:16.569327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 528/1056] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:16.596177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d6849-1dfa-491f-950a-deb8f3e7442f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.608201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d6849-1dfa-491f-950a-deb8f3e7442f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.612507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.613315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.613597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.613870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.624187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:16.632216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:59:16.633429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 529/1057] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:16.639311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.648748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967e3b2-6248-4e4c-99b1-e696fc0684ef None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.653220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.653872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.654150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.654422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.655160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:16.655463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.657073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.665099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 529/1058] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:16.670399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.680280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5aa33-deb6-4430-8bdb-64613269b11b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.684726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.685517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.685823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.686096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.696660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.698502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.714650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:16.715781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 530/1059] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:16.721688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.731410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e6b97-e9d8-465e-a990-ce73887de331 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.736088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.736735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.737018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.737324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.738040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:16.738347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.740438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.753030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 530/1060] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:16.759645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.769364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ba8c5-eecb-4c49-a290-120c652f1e93 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.773856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.774622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.774902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.775175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.782321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.784343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.797855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:59:16.798978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 531/1061] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:16.805183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.814703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911109c-552e-41ad-8b1e-c1732216cb5a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.819759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.820404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.820683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.820956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.821811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:16.822115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.823920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.840513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 531/1062] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:16.846032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.855428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9261-66c0-4943-86af-f3cfec34b27e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.859834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.860590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.860864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.861159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.871541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.873357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.890441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:16.891768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 532/1063] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:59:16.897069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.907533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7247166-a938-4b38-a243-474f1045c79e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.912043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.912684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.912966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.913273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.913984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:16.914287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.915851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.927322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 532/1064] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:16.932986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.943459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12624-eaca-4f4c-a906-f28391c5b14d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.949325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.950093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.950375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.950648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.957443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.959371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:16.972064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:59:16.973245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 533/1065] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:16.979135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:16.989215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132df15-fef1-4dad-bac5-4cb7a518e857 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:16.993646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:16.994277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:16.994557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:16.994830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:16.995596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:16.995900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:16.997751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f86f3-b432-42bd-a2c2-8ad5319f9e1f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:17.010242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 533/1066] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:17.015984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:17.026247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073c59-9e3c-4a2d-a678-6df781d84844 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:17.030760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:17.031612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:17.031891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:17.032162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/3f308046957542cb83c53c9d70ad52ad` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:17.034437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=3f538116ef3047e092d7680577ac75f1, role_id=3f308046957542cb83c53c9d70ad52ad)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:17.037751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda74a1-6c95-49e5-846a-c9581fa6d126 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:17.050995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 534/1067] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:59:17 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/3f538116ef3047e092d7680577ac75f1/roles/3f308046957542cb83c53c9d70ad52ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:59:18.246079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e6e6-5d7a-4818-9214-fd13291112f5 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.246622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e6e6-5d7a-4818-9214-fd13291112f5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.246622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e6e6-5d7a-4818-9214-fd13291112f5 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.248520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 534/1068] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:18.253868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.254271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.254411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.276061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:18.277289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:18.334578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 535/1069] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:18.358881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e6e6-5d7a-4818-9214-fd13291112f5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.370776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e6e6-5d7a-4818-9214-fd13291112f5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.375122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.376078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.376433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.376709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.386977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:18.393662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:18.394781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 535/1070] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:18.401077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.409726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106e61a-3d16-4565-9955-0ea6bf357ded None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.414769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.415411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.415688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.415960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.416696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:18.416999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:18.418595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:18.426637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 536/1071] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:18.431879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.441930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de1f4-d50d-48a8-9e3d-9fee92e7c39d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.446449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.447304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.447583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.447855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] PATH_INFO: `/v3/users/0ad29f54711846869e9289144acdc970` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.460988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] RBAC: Authorizing `identity:get_user(user_id=0ad29f54711846869e9289144acdc970)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:18.463115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:18.464869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 536/1072] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/users/0ad29f54711846869e9289144acdc970 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:18.470267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.480207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f7138-0881-4463-b0f3-f5353efd65da admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.484574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.485219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.485502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.485763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.493174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:18.494873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:18.503504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 537/1073] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 09:59:18.509437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.518820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcf304-f312-460b-a350-4d219937fb00 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.524216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.525042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.525349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.525623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.526778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:18.528772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572cb61-7158-4313-927d-7fe818ed8f72 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:18.530433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 537/1074] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:18.536705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:18.545138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47825994-7500-49e1-8da7-eacf12734ca8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:18.549533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:18.550149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:18.550422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:18.550687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:18.551502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=b423824956174bd8a71cae5226288a68, user.id=0ad29f54711846869e9289144acdc970) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:18.551806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:18.553606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b8db4-6543-4aa8-a2a1-d08acf049410 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:18.558794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 538/1075] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:18 2022] GET /identity/v3/role_assignments?user.id=0ad29f54711846869e9289144acdc970&scope.project.id=b423824956174bd8a71cae5226288a68&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:19.334746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df216ab-5914-4332-99bd-a57ca43eb716 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.335288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df216ab-5914-4332-99bd-a57ca43eb716 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.335288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df216ab-5914-4332-99bd-a57ca43eb716 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.337074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 538/1076] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:19.342198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.342595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.342958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.360183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:19.361370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:19.368996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 539/1077] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:19.393005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df216ab-5914-4332-99bd-a57ca43eb716 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.405658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df216ab-5914-4332-99bd-a57ca43eb716 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.409967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.410755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.411032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.411302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.421247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:19.428422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 21 09:59:19.429601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 539/1078] 10.222.0.73 () {56 vars in 1141 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:19.435366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.444598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f31e9-ae17-4a5c-802b-0272de95c6a9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.449081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.449721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.449994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.450258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.450991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.451286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.452838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.461148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 540/1079] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:19.466425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.476350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97607a-3d94-408c-b439-976b1c64d7a4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.480841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.481619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.481896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.482166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.491853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.493742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.510470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:19.511594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 540/1080] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:19.517280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.527359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1de2b-7d4d-46bd-820f-ef52d2001ef1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.531757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.532385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.532660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.532926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.533659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.533957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.535508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.546774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 541/1081] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:19.552313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.561636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f086-d518-42af-8545-dc667658b29f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.566072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.567336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.567612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.567879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.575045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.577131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.591048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 21 09:59:19.592167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 541/1082] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:19.598146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.607605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1464-397e-459a-9f1b-4b8dc97de243 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.612163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.612880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.613272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.613613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.614509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.614899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.616761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.634071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 542/1083] 10.222.0.73 () {56 vars in 1154 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:19.639542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.649609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1e93-002a-41fc-b87a-7d1033a8a433 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.654159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.654808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.655087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.655359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.663983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.665770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.675054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 542/1084] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:19.681272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.690682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678edf2-8014-4a8a-98e2-1078a80db421 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.695728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.696489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.696763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.697030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.706889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.708668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.724523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 09:59:19.725818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 543/1085] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:19.731224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.740517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23f63c-0eca-47aa-b82f-4b13076b55c2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.745181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.745890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.746253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.746592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.747366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.747736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.749448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.761480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 543/1086] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:19.766852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.776154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338531-ad85-4c15-a5ab-ce6b3eb46609 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.780534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.781309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.781583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.781848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.788323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.790241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.803134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 09:59:19.804233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 544/1087] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 09:59:19.809789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.819819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1284af-4bf2-4b6c-9ef4-116e51580f1d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.824289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.824917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.825243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.825522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.826291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.826599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.828482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6915-02db-4ebf-a63d-499b2f04e2af admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.840280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 544/1088] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:19.845941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:19.855913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08b51fd-13e0-490d-9b13-d3789444c3e3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:19.860248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:19.860845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:19.861145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:19.861417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:19.862223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] RBAC: Adding query filter params (role.id=3f308046957542cb83c53c9d70ad52ad, scope.project.id=395510de8de542388e9d42e99270937b, user.id=3f538116ef3047e092d7680577ac75f1) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:19.862526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:19.864822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8225-c539-4e39-a973-bdb88d656d5f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:19.870350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 545/1089] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:19 2022] GET /identity/v3/role_assignments?user.id=3f538116ef3047e092d7680577ac75f1&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3f308046957542cb83c53c9d70ad52ad => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:20.834861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8231a-06e3-4482-9722-ddeeb744b6a2 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:20.835408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8231a-06e3-4482-9722-ddeeb744b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:20.835408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8231a-06e3-4482-9722-ddeeb744b6a2 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:20.837189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 545/1090] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:20.842380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:20.842815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:20.842919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:20.859497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:20.860646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:20.868104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 546/1091] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:20.891684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8231a-06e3-4482-9722-ddeeb744b6a2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:20.904073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8231a-06e3-4482-9722-ddeeb744b6a2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:20.908378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:20.909163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:20.909442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:20.909714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:20.919431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:20.926224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:20.927326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 546/1092] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:20.932741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:20.941386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478536c-7a9b-461c-8ccc-7cc745769a32 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:20.946280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:20.946907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:20.947184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:20.947451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:20.948178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:20.948477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:20.950061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:20.958593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 547/1093] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:20.963838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:20.973820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97350-cb2d-4654-b1bb-5cfbb8abede6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:20.978231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:20.979043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:20.979320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:20.979587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] PATH_INFO: `/v3/users/0ad29f54711846869e9289144acdc970` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:20.980743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] RBAC: Authorizing `identity:get_user(user_id=0ad29f54711846869e9289144acdc970)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:20.982862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:20.984390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 547/1094] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:20 2022] GET /identity/v3/users/0ad29f54711846869e9289144acdc970 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:20.994498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:21.008016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49937b-e6f7-4160-b722-034880b64a59 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:21.013398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:21.014231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:21.014512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:21.014784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:21.015940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:21.017979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d735cbc-9db0-4391-9eb4-e95f0e5c5b3e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:21.020403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 548/1095] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:20 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:21.026164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:21.035643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e17e1e-06ff-43d2-a5da-1e63b853a755 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:21.040073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:21.040920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:21.041232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:21.041503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68/users/0ad29f54711846869e9289144acdc970/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:21.043503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b423824956174bd8a71cae5226288a68, user_id=0ad29f54711846869e9289144acdc970, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:21.046111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1ce6f-ca86-43d5-ad48-8265c0ebb6be admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:21.058345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 548/1096] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:59:21 2022] PUT /identity/v3/projects/b423824956174bd8a71cae5226288a68/users/0ad29f54711846869e9289144acdc970/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 09:59:23.343592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e894f-0c77-4ac1-a283-9691838af356 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.344132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e894f-0c77-4ac1-a283-9691838af356 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.344132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e894f-0c77-4ac1-a283-9691838af356 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.345960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 549/1097] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:23.351704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.352099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.352249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.369908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:23.371097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:23.424918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 549/1098] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:23.449212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e894f-0c77-4ac1-a283-9691838af356 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.461587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e894f-0c77-4ac1-a283-9691838af356 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.465922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.466684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.466966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.467241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.478232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:23.485084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:23.486202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 550/1099] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:23.491634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.500423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09010-d1c6-4913-90ab-0a1175143f8a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.504811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.505479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.505757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.506027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.507028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:23.507328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:23.508906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:23.516753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 550/1100] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:23.522564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.531892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f325a-0dd2-4121-a9e5-e19427d25fe8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.536927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.537781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.538060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.538334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] PATH_INFO: `/v3/users/0ad29f54711846869e9289144acdc970` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.539502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=0ad29f54711846869e9289144acdc970)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:23.541617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:23.543294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 551/1101] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/users/0ad29f54711846869e9289144acdc970 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:23.548449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.557712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e41cc-3f42-4d5c-9339-c96a2f781e46 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.562163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.562772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.563052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.563326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.570861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:23.572549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:23.581129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 551/1102] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:23.586898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.596262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217bd78-7b94-4366-96fc-ad9eba8543c9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.601299 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.602097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.602376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.602649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.603788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:23.605810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8f838-60b8-428d-b202-a4723a32423c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:23.607579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 552/1103] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:23.612697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:23.621033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b68a6a-806a-4084-9180-a976e1fb6305 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:23.625613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:23.626217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:23.626507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:23.626764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:23.627565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=b423824956174bd8a71cae5226288a68, user.id=0ad29f54711846869e9289144acdc970) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:23.627872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:23.629690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66217d1-8028-4277-95ff-5531b1ce3867 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:23.635598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 552/1104] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:23 2022] GET /identity/v3/role_assignments?user.id=0ad29f54711846869e9289144acdc970&scope.project.id=b423824956174bd8a71cae5226288a68&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:25.924008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a561-7d1d-4dde-a158-182869ec43d3 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:25.924563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a561-7d1d-4dde-a158-182869ec43d3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:25.924563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a561-7d1d-4dde-a158-182869ec43d3 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:25.926378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 553/1105] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:25.931537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:25.931933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:25.932081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:25.949297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:25.950453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:25.958426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 553/1106] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:25.982802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a561-7d1d-4dde-a158-182869ec43d3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:25.994455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a561-7d1d-4dde-a158-182869ec43d3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:25.998711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:25.999480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:25.999759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:26.000022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:26.001184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:26.002834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a025c83-cea8-4216-aafe-848033dd850f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:26.004358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 554/1107] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:26.009592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:26.018042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84895b65-2668-4f78-a4f4-6ffe6f4b336c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:26.022933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:26.023564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:26.023842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:26.024112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:26.024795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:26.026672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149fe01-3feb-4497-a3b1-53462139eb29 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:26.045846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 554/1108] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:59:26 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:28.362588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651a8c-bff9-4206-b000-824141331b44 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.363089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651a8c-bff9-4206-b000-824141331b44 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.363089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5651a8c-bff9-4206-b000-824141331b44 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.365417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 555/1109] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:28.370596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.371037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.371132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.389366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:28.390529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:28.397987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 555/1110] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:28.422173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651a8c-bff9-4206-b000-824141331b44 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:28.434512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5651a8c-bff9-4206-b000-824141331b44 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:28.438971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:28.439784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.440062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.440333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] PATH_INFO: `/v3/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.441825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] RBAC: Authorizing `identity:get_role(role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:28.442834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:59:28.442834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:59:28.442834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:59:28.443689 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:28.444985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 556/1111] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:28 2022] GET /identity/v3/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:28.450185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:28.458832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ebc2-79ad-4e07-8ecc-26d4c151802c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:28.463319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:28.464153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.464434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.464706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] PATH_INFO: `/v3/users/9fcceabb765a43aab8d8d2dae5b37080` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.594826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fcceabb765a43aab8d8d2dae5b37080)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:28.596918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:28.599242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 556/1112] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:28 2022] GET /identity/v3/users/9fcceabb765a43aab8d8d2dae5b37080 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:28.605170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:28.615159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb1624-abc9-4d01-b00e-d96f917be7c3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:28.619533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:28.620148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.620424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.620695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.628114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:28.629833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:28.638525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 557/1113] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:28 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:28.643798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:28.653443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a72c0-9f63-4a8e-8930-9c06a16c2fd2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:28.661969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:28.662798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.663079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.663353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.664510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:28.666527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66065584-8fbf-4120-ab22-9638d48d41c9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:28.668169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 557/1114] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:28 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:28.674174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:28.682764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8515e9-a864-4481-86b8-59be3eb71229 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:28.687270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:28.687878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:28.688151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:28.688416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:28.689258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=b423824956174bd8a71cae5226288a68, user.id=9fcceabb765a43aab8d8d2dae5b37080) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:28.689561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:28.691323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d48718-c107-4bbf-b843-3fa2a08751ef admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:28.696568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 558/1115] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:28 2022] GET /identity/v3/role_assignments?user.id=9fcceabb765a43aab8d8d2dae5b37080&scope.project.id=b423824956174bd8a71cae5226288a68&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:30.930002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d1ea-9229-41c4-b9af-f1236dbe1d19 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:30.930532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d1ea-9229-41c4-b9af-f1236dbe1d19 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:30.930532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793d1ea-9229-41c4-b9af-f1236dbe1d19 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:30.932290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 558/1116] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:30.937435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:30.937857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:30.937991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:30.955744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:30.956954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:30.964454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 559/1117] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:30.987364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793d1ea-9229-41c4-b9af-f1236dbe1d19 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:30.999729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793d1ea-9229-41c4-b9af-f1236dbe1d19 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:31.004656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:31.005506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:31.005782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:31.006051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] PATH_INFO: `/v3/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:31.007753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] RBAC: Authorizing `identity:get_role(role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:31.008744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:59:31.008744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 09:59:31.008744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 09:59:31.009632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:31.010919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 559/1118] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:30 2022] GET /identity/v3/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:31.016998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:31.025655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a77fc-3d6e-43f8-85be-aee7ecf43d3d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:31.030131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:31.030967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:31.031246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:31.031521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] PATH_INFO: `/v3/users/9fcceabb765a43aab8d8d2dae5b37080` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:31.032703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fcceabb765a43aab8d8d2dae5b37080)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:31.034822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:31.036412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 560/1119] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:31 2022] GET /identity/v3/users/9fcceabb765a43aab8d8d2dae5b37080 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:31.041647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:31.051230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d26cf-e3f9-4227-bc94-b49cf0fd4174 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:31.055644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:31.056432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:31.056712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:31.056980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:31.058159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:31.060109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e066ae-d23d-4398-8418-fbd45c4ea376 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:31.061726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 560/1120] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:31 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:31.067513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:31.076499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b53db4-2a3a-4925-a60a-7b4d41adced8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:31.080936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:31.081787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:31.082066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:31.082337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68/users/9fcceabb765a43aab8d8d2dae5b37080/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:31.084528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b423824956174bd8a71cae5226288a68, user_id=9fcceabb765a43aab8d8d2dae5b37080, role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:31.087085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d65f91-2611-4c33-bdc9-a1ccb9b050b6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:31.100973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 561/1121] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:59:31 2022] PUT /identity/v3/projects/b423824956174bd8a71cae5226288a68/users/9fcceabb765a43aab8d8d2dae5b37080/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:59:33.394270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f273-233d-41db-9379-658a4f4e014a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.394913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f273-233d-41db-9379-658a4f4e014a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.394913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486f273-233d-41db-9379-658a4f4e014a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.396506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 561/1122] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:33.401605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.402038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.402134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.419275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:33.420429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:33.474508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 562/1123] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:33.498665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f273-233d-41db-9379-658a4f4e014a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:33.511509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486f273-233d-41db-9379-658a4f4e014a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:33.515790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:33.516606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.516886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.517191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] PATH_INFO: `/v3/roles/9457d9e140f84d1c9638d0e54f4763ff` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.518625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] RBAC: Authorizing `identity:get_role(role_id=9457d9e140f84d1c9638d0e54f4763ff)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:33.520180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:33.521513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 562/1124] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:33 2022] GET /identity/v3/roles/9457d9e140f84d1c9638d0e54f4763ff => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:33.526715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:33.535927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4e3c1-ba8d-4ce8-95d6-266c2b018dbc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:33.540642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:33.541512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.541794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.542065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] PATH_INFO: `/v3/users/9fcceabb765a43aab8d8d2dae5b37080` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.543248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] RBAC: Authorizing `identity:get_user(user_id=9fcceabb765a43aab8d8d2dae5b37080)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:33.545373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:33.547174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 563/1125] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:33 2022] GET /identity/v3/users/9fcceabb765a43aab8d8d2dae5b37080 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:33.552656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:33.561681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483cc5f-6e8a-4fbb-afc4-332cc25d0ca2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:33.566057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:33.566650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.566924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.567192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.574512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:33.576147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:33.584677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 563/1126] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:33.589907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:33.599528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654240a-da44-4ab5-8b5d-b6ae203e7c04 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:33.603972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:33.604749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.605026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.605328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] PATH_INFO: `/v3/projects/b423824956174bd8a71cae5226288a68` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.606462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] RBAC: Authorizing `identity:get_project(project_id=b423824956174bd8a71cae5226288a68)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:33.608395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffe429-fc57-454b-a6d8-086557b12729 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:33.610171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 564/1127] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:33 2022] GET /identity/v3/projects/b423824956174bd8a71cae5226288a68 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:33.615939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:33.624153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eff42e3-d475-40ff-bb4b-d881c811781c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:33.628711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:33.629342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:33.629621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:33.629888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:33.630685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] RBAC: Adding query filter params (role.id=9457d9e140f84d1c9638d0e54f4763ff, scope.project.id=b423824956174bd8a71cae5226288a68, user.id=9fcceabb765a43aab8d8d2dae5b37080) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:33.630993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:33.632978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1780832-5c9b-4030-8fc1-2344d7161adb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:33.638603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 564/1128] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:33 2022] GET /identity/v3/role_assignments?user.id=9fcceabb765a43aab8d8d2dae5b37080&scope.project.id=b423824956174bd8a71cae5226288a68&role.id=9457d9e140f84d1c9638d0e54f4763ff => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:35.930958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e87e7-8840-479f-9102-f173a3d0f445 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:35.931511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e87e7-8840-479f-9102-f173a3d0f445 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:35.931511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e87e7-8840-479f-9102-f173a3d0f445 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:35.933316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 565/1129] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:35.938545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30402-ed96-4a07-a88e-48455530682f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:35.938947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30402-ed96-4a07-a88e-48455530682f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:35.939094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b30402-ed96-4a07-a88e-48455530682f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:35.956649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-40b30402-ed96-4a07-a88e-48455530682f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:35.958450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-40b30402-ed96-4a07-a88e-48455530682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:35.965951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 565/1130] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:35.988759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e87e7-8840-479f-9102-f173a3d0f445 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:36.000498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e87e7-8840-479f-9102-f173a3d0f445 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:36.005810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:36.006628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:36.006910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:36.007185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:36.008348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:36.010035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1aea7-e758-412e-bdcd-9b3c85cb193f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:36.011598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 566/1131] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:36.016779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b30402-ed96-4a07-a88e-48455530682f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:36.025968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b30402-ed96-4a07-a88e-48455530682f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:36.030427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:36.031053 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:36.031331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:36.031601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:36.032318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:36.034193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2eafac-f7eb-4455-bd0d-8375b0e3c710 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:36.059155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 566/1132] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:36 2022] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:38.352808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c00af-2fb2-4fc8-aa6b-f771b908b7d4 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:38.353344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c00af-2fb2-4fc8-aa6b-f771b908b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:38.353344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c00af-2fb2-4fc8-aa6b-f771b908b7d4 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:38.355070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 567/1133] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:38.360234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:38.360663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:38.360785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:38.378541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:38.379716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:38.434469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 567/1134] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:38.459639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c00af-2fb2-4fc8-aa6b-f771b908b7d4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:38.471396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c00af-2fb2-4fc8-aa6b-f771b908b7d4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:38.476166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:38.476916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:38.477230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:38.477502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:38.478632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:38.480269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3fb4-2fd3-46f9-a4bb-c57b0a7df0bf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:38.481838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 568/1135] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 09:59:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:38.487015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:38.495597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3bdf3-1f70-4efe-9b28-469b926171f1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:38.500076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:38.500717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:38.501001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:38.501308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:38.502006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:38.503897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ee644-240c-4a24-a58e-f44f1c530cf5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:38.523572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 568/1136] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:59:38 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:40.843001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310b2db-e237-4211-9dd7-b864b1c5c099 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:40.843576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310b2db-e237-4211-9dd7-b864b1c5c099 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:40.843576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310b2db-e237-4211-9dd7-b864b1c5c099 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:40.845345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 569/1137] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:40.851114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:40.851508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:40.851671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:40.869416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:40.870593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:40.878231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 569/1138] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:40.902508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310b2db-e237-4211-9dd7-b864b1c5c099 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:40.914160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310b2db-e237-4211-9dd7-b864b1c5c099 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:40.918409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:40.919156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:40.919428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:40.919698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:40.929816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:40.936520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:40.937647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 570/1139] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:40.943863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:40.952468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ca769-9bd4-4a8d-9146-0cb368438398 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:40.956936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:40.957607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:40.957889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:40.958162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:40.958903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:40.959210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:40.960773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:40.968776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 570/1140] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:40.974152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:40.983777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc1c8-a8b4-4a6d-bb01-e4fca9094405 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:40.988684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:40.989532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:40.989814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:40.990085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] PATH_INFO: `/v3/users/ae2c3431277c40529ea9112fce3d5abe` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:41.002490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae2c3431277c40529ea9112fce3d5abe)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:41.005205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:41.007038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 571/1141] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:40 2022] GET /identity/v3/users/ae2c3431277c40529ea9112fce3d5abe => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:41.012351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:41.021523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2394-30b2-40ff-bec3-e264e0827b00 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:41.025924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:41.026532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:41.026812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:41.027084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:41.034512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:41.036695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:41.045218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 571/1142] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:41.051089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:41.060145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14306dd6-b17b-48f1-8477-207b490b5e67 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:41.064591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:41.065413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:41.065692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:41.066057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] PATH_INFO: `/v3/projects/8535f261abec4d32add17d164a5068b5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:41.067193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=8535f261abec4d32add17d164a5068b5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:41.069183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f20cfb-5e00-478d-97be-df4d07e124e5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:41.070785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 572/1143] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:41 2022] GET /identity/v3/projects/8535f261abec4d32add17d164a5068b5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:41.076081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:41.084286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5db5e-2b65-4bcb-b49e-bbf5d16021e5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:41.088705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:41.089347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:41.089628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:41.089900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:41.090705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=8535f261abec4d32add17d164a5068b5, user.id=ae2c3431277c40529ea9112fce3d5abe) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:41.091009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:41.092921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173eae-c601-452a-993d-078afdd17552 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:41.099659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 572/1144] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:41 2022] GET /identity/v3/role_assignments?user.id=ae2c3431277c40529ea9112fce3d5abe&scope.project.id=8535f261abec4d32add17d164a5068b5&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:43.346418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826fd-1d92-4a67-89f5-38f6cd0b786e None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.346978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826fd-1d92-4a67-89f5-38f6cd0b786e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.346978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938826fd-1d92-4a67-89f5-38f6cd0b786e None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.348748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 573/1145] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:43.354046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.354476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.354605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.372101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:43.373307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:43.381696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 573/1146] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:43.404777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938826fd-1d92-4a67-89f5-38f6cd0b786e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:43.416621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938826fd-1d92-4a67-89f5-38f6cd0b786e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:43.421041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:43.421831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.422114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.422386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.432233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:43.439021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:43.440140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 574/1147] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:43.446223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:43.454872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacbb79-c81c-49d5-bf8d-cff94d4f6fd9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:43.459984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:43.460624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.460905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.461218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.461958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:43.462262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:43.463827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:43.471771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 574/1148] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:43.477176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:43.487064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff35fb6-403d-4a5f-b40d-44c3b5e378c3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:43.491550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:43.492363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.492639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.492910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] PATH_INFO: `/v3/users/ae2c3431277c40529ea9112fce3d5abe` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.494124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] RBAC: Authorizing `identity:get_user(user_id=ae2c3431277c40529ea9112fce3d5abe)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:43.496198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:43.497909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 575/1149] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:43 2022] GET /identity/v3/users/ae2c3431277c40529ea9112fce3d5abe => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:43.502840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:43.512703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27d5a-72c8-4db9-b07c-8f661698eb6c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:43.517133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:43.517948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.518226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.518494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] PATH_INFO: `/v3/projects/8535f261abec4d32add17d164a5068b5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.520290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] RBAC: Authorizing `identity:get_project(project_id=8535f261abec4d32add17d164a5068b5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:43.522298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e785347-3794-42d1-b530-0e4581651b55 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:43.523877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 575/1150] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:43 2022] GET /identity/v3/projects/8535f261abec4d32add17d164a5068b5 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:43.529235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:43.539021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0f289-168a-4b24-8926-015e7b0824ab admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:43.543459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:43.544280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:43.544557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:43.544829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] PATH_INFO: `/v3/projects/8535f261abec4d32add17d164a5068b5/users/ae2c3431277c40529ea9112fce3d5abe/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:43.546845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8535f261abec4d32add17d164a5068b5, user_id=ae2c3431277c40529ea9112fce3d5abe, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:43.549404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aae088-a4f9-481e-a758-13886fb4b08e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:43.562079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 576/1151] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 09:59:43 2022] PUT /identity/v3/projects/8535f261abec4d32add17d164a5068b5/users/ae2c3431277c40529ea9112fce3d5abe/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 09:59:45.814531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1e8b-820c-4509-98c7-0067e9ce6dc0 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:45.815078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1e8b-820c-4509-98c7-0067e9ce6dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:45.815078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1e8b-820c-4509-98c7-0067e9ce6dc0 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:45.816862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 576/1152] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:45.822037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:45.822403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:45.822587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:45.840820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:45.842036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:45.897887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 577/1153] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:45.922038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1e8b-820c-4509-98c7-0067e9ce6dc0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:45.933889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1e8b-820c-4509-98c7-0067e9ce6dc0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:45.938199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:45.938956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:45.939238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:45.939509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:45.949223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:45.955960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:45.957614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 577/1154] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:45.963111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:45.971685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c872-606c-461e-bc2d-4a3f314c94e0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:45.976768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:45.977443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:45.977725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:45.977999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:45.978734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:45.979038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:45.980622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:45.988521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 578/1155] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 09:59:45.994002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:46.003706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc384-3cf7-45d0-b24b-464d520775ad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:46.008411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:46.009252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:46.009534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:46.009806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] PATH_INFO: `/v3/users/ae2c3431277c40529ea9112fce3d5abe` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:46.010976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] RBAC: Authorizing `identity:get_user(user_id=ae2c3431277c40529ea9112fce3d5abe)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:46.013073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:46.014651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 578/1156] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:45 2022] GET /identity/v3/users/ae2c3431277c40529ea9112fce3d5abe => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:46.020275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:46.029329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c24b6-9222-4a69-b1fe-6cc3099e934f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:46.033808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:46.034978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:46.035264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:46.035536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:46.043024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:46.044689 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:46.053207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 579/1157] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:46.058421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:46.067535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16045dfe-295d-462b-9869-cfd7588e5f9c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:46.071935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:46.072721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:46.072997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:46.073301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] PATH_INFO: `/v3/projects/8535f261abec4d32add17d164a5068b5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:46.074433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] RBAC: Authorizing `identity:get_project(project_id=8535f261abec4d32add17d164a5068b5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:46.076375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21ff8b-5229-43d8-afe4-d03fa2d19875 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:46.078112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 579/1158] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:46 2022] GET /identity/v3/projects/8535f261abec4d32add17d164a5068b5 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:46.083705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:46.091992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17131841-5fd6-4137-9b4d-7afdb63b02dc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:46.096481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:46.097742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:46.098021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:46.098288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:46.099092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=8535f261abec4d32add17d164a5068b5, user.id=ae2c3431277c40529ea9112fce3d5abe) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:46.099394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:46.101182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa375-c8c5-4050-b3fc-369ec306b5d5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:46.106723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 580/1159] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:46 2022] GET /identity/v3/role_assignments?user.id=ae2c3431277c40529ea9112fce3d5abe&scope.project.id=8535f261abec4d32add17d164a5068b5&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:48.430171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28ce7-d9bf-47c2-9751-106f17fdf135 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:48.430691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28ce7-d9bf-47c2-9751-106f17fdf135 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:48.430691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28ce7-d9bf-47c2-9751-106f17fdf135 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:48.432410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 580/1160] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:48.437703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:48.438136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:48.438243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:48.455469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:48.457219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:48.464766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 581/1161] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 09:59:48.487272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28ce7-d9bf-47c2-9751-106f17fdf135 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:48.499038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28ce7-d9bf-47c2-9751-106f17fdf135 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:48.503321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:48.503925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:48.504200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:48.504466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:48.512121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:48.513871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:48.524002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 581/1162] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:48.529288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:48.538694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ff134-e80c-4f91-b631-d1eaeb63e699 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:48.543234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:48.543997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:48.544278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:48.544549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:48.551195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:48.552987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:48.568874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-7d4d76c8-0f6a-424f-be82-2b0b854ea7bb admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 21 09:59:48.570011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 582/1163] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 09:59:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:48.575594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:48.584874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a534c-8168-47dd-8a48-b551a5b69c4a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:48.589297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:48.589929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:48.590207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:48.590479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:48.591176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:48.591475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:48.593012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48721854-d783-49dd-91f3-a0f8a6ff5305 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:48.600502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 582/1164] 10.222.0.73 () {56 vars in 1136 bytes} [Mon Feb 21 09:59:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:50.888810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb39-53bb-4b99-a8b3-248c144fe24a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:50.889422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb39-53bb-4b99-a8b3-248c144fe24a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:50.889422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dcb39-53bb-4b99-a8b3-248c144fe24a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:50.891146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 583/1165] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:50.896983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e90-ff40-4e95-9630-9ffe56cadb63 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:50.897393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e90-ff40-4e95-9630-9ffe56cadb63 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:50.897561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2159e90-ff40-4e95-9630-9ffe56cadb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:50.914791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e2159e90-ff40-4e95-9630-9ffe56cadb63 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:50.915960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e2159e90-ff40-4e95-9630-9ffe56cadb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:50.923504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 583/1166] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:50.946217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dcb39-53bb-4b99-a8b3-248c144fe24a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:50.958591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dcb39-53bb-4b99-a8b3-248c144fe24a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:50.962883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:50.963500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:50.963772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:50.964037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:50.964760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:50.965774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 21 09:59:50.965774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 09:59:50.965774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 09:59:50.966620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb53fa-58c7-4ea3-97d1-6d90ab0200d0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:50.980519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 584/1167] 10.222.0.73 () {60 vars in 1159 bytes} [Mon Feb 21 09:59:50 2022] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:53.255761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67f874-3cce-40fa-93ec-01630363f5a4 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:53.256553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67f874-3cce-40fa-93ec-01630363f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:53.256553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67f874-3cce-40fa-93ec-01630363f5a4 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:53.258387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 584/1168] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:53.263398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:53.263780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:53.263948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:53.282391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:53.283547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:53.337661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 585/1169] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:53.360465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67f874-3cce-40fa-93ec-01630363f5a4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:53.372367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67f874-3cce-40fa-93ec-01630363f5a4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:53.376754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:53.377621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:53.378418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:53.378691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] PATH_INFO: `/v3/domains/ddf9750fd361430dba0d995501d38251` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:53.389158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ddf9750fd361430dba0d995501d38251)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:53.391093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7788845-9e6e-44bf-900d-8ec37ba8e2d0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:53.392652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 585/1170] 10.222.0.73 () {56 vars in 1204 bytes} [Mon Feb 21 09:59:53 2022] GET /identity/v3/domains/ddf9750fd361430dba0d995501d38251 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:53.398560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:53.407081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbbcc0-f35e-450f-b274-52b5b7ad1f0e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:53.411534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:53.412158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:53.412434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:53.412704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:53.413423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:53.415263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0d08d-7603-4821-a299-74d32dc66698 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:53.439757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 586/1171] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 09:59:53 2022] POST /identity/v3/projects => generated 361 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 09:59:55.729100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53e2d-25a3-450b-8360-5eb8fa340831 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:55.729628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53e2d-25a3-450b-8360-5eb8fa340831 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:55.729628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac53e2d-25a3-450b-8360-5eb8fa340831 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:55.731398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 586/1172] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:55.736426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:55.736811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:55.736974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:55.754131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:55.755286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:55.808795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 587/1173] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:55.833508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac53e2d-25a3-450b-8360-5eb8fa340831 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:55.845321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac53e2d-25a3-450b-8360-5eb8fa340831 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:55.850305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:55.851133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:55.851410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:55.851682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] PATH_INFO: `/v3/domains/ddf9750fd361430dba0d995501d38251` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:55.852851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ddf9750fd361430dba0d995501d38251)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:55.854784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fbc8d-7d8b-4735-92f7-123a5ff18a9a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:55.856316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 587/1174] 10.222.0.73 () {56 vars in 1204 bytes} [Mon Feb 21 09:59:55 2022] GET /identity/v3/domains/ddf9750fd361430dba0d995501d38251 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:55.861714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:55.870285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318854e-6246-476b-b8dd-4d2986c4d927 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:55.874693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:55.875330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:55.875605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:55.875873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:55.876568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:55.878451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04d5a-5256-4746-b71b-5d8f86ba819a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:55.897942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 588/1175] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 09:59:55 2022] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 09:59:58.240335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656333-f87e-46fc-bfc1-7b1d83c2f587 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.240845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656333-f87e-46fc-bfc1-7b1d83c2f587 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.240959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92656333-f87e-46fc-bfc1-7b1d83c2f587 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.242689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 588/1176] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 09:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 09:59:58.247882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.248265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.248427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.266586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 09:59:58.267739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 09:59:58.275310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 589/1177] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 09:59:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 09:59:58.299424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656333-f87e-46fc-bfc1-7b1d83c2f587 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.312149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92656333-f87e-46fc-bfc1-7b1d83c2f587 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.316438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.317239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.317519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.317790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.327937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 09:59:58.334668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 09:59:58.335781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 589/1178] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 09:59:58.341400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.350603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e65b3-1919-435f-ba68-17eef8c64fe7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.354931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.355564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.355839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.356106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.356839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:58.357164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:58.358714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:58.367259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 590/1179] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:58.372779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.382265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a0f0f-7f9e-4851-b61c-3b7f36790a27 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.386715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.387531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.387807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.388078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] PATH_INFO: `/v3/users/4c391b2f54c040a29246386961b7ff60` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.400883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c391b2f54c040a29246386961b7ff60)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:58.403006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:58.404558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 590/1180] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/users/4c391b2f54c040a29246386961b7ff60 => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:58.410379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.419531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf6f41-565f-4d66-b2df-8986dfb07df0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.423930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.424531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.425373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.425643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.433025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:58.434737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:58.443174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 591/1181] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 09:59:58.448363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.457339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064a509-01dd-454a-b87c-5363c42776f6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.461745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.462540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.462818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.463087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] PATH_INFO: `/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.464207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e5d1ad92d1954b0ab6948deff06a8f22)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:58.466183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f678ae5-869c-4fb9-947e-b2ffc99848e0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:58.467753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 591/1182] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 09:59:58.473531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 09:59:58.481886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a2c83-1604-4908-ba9a-7a5e12993e7f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 09:59:58.486417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 09:59:58.487012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 09:59:58.487903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 09:59:58.488175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 09:59:58.488967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=e5d1ad92d1954b0ab6948deff06a8f22, user.id=4c391b2f54c040a29246386961b7ff60) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 09:59:58.489303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 09:59:58.491043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dd617-86a5-4310-843e-725407cc4ad8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 09:59:58.496157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 592/1183] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 09:59:58 2022] GET /identity/v3/role_assignments?user.id=4c391b2f54c040a29246386961b7ff60&scope.project.id=e5d1ad92d1954b0ab6948deff06a8f22&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:00:00.743544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f384-e290-4ecd-a5d4-4f58cefaa7d8 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.744093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f384-e290-4ecd-a5d4-4f58cefaa7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.744093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9f384-e290-4ecd-a5d4-4f58cefaa7d8 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.745881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 592/1184] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:00:00.751094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.751460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.751648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.769040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:00:00.770221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:00:00.777642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 593/1185] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:00:00.801164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9f384-e290-4ecd-a5d4-4f58cefaa7d8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:00.812761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9f384-e290-4ecd-a5d4-4f58cefaa7d8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:00.817004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:00.817776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.818054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.818320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.828048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:00:00.834829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 10:00:00.835925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 593/1186] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 10:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:00:00.841576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:00.850707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684da2b-0eee-4653-b708-55250bd5c704 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:00.855179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:00.855807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.856084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.856357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.857124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:00:00.857429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:00.858995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:00.867456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 594/1187] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 10:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:00:00.872708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:00.882560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca87b14-37b2-400d-9946-60acdbd6e757 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:00.886880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:00.887682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.887958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.888227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] PATH_INFO: `/v3/users/4c391b2f54c040a29246386961b7ff60` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.889390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c391b2f54c040a29246386961b7ff60)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:00.891436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:00.892955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 594/1188] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 10:00:00 2022] GET /identity/v3/users/4c391b2f54c040a29246386961b7ff60 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:00:00.898602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:00.907618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fdefc-401c-40f2-98b5-db57713678fa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:00.912630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:00.913456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.913737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.914009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] PATH_INFO: `/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.915150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e5d1ad92d1954b0ab6948deff06a8f22)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:00.917138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf11c2-ff5b-43d6-b718-4ac7e9c39cd2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:00.918726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 595/1189] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 10:00:00 2022] GET /identity/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:00:00.923778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:00.932919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33638ecb-eb18-426b-b278-461b1ff58d53 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:00.937330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:00.938147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:00.938425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:00.938695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] PATH_INFO: `/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22/users/4c391b2f54c040a29246386961b7ff60/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:00.940563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d1ad92d1954b0ab6948deff06a8f22, user_id=4c391b2f54c040a29246386961b7ff60, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:00.943108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7e302-b68e-4921-8f96-7de9bc6a3bc4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:00.954950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 595/1190] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 10:00:00 2022] PUT /identity/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22/users/4c391b2f54c040a29246386961b7ff60/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:00:03.214471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9572-9072-44f8-b3c0-52ccae130290 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.215000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9572-9072-44f8-b3c0-52ccae130290 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.215000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d9572-9072-44f8-b3c0-52ccae130290 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.216790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 596/1191] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:00:03.222467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.222864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.223012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.240921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:00:03.242121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:00:03.297452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 596/1192] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:00:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:00:03.320748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d9572-9072-44f8-b3c0-52ccae130290 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.333225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d9572-9072-44f8-b3c0-52ccae130290 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.337508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.338270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.338550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.338824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.349304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:00:03.355972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 10:00:03.357117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 597/1193] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:00:03.362865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.371451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993ca2f-90ca-4640-8ce3-f6f23babb595 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.375881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.376527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.376804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.377093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.377867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:00:03.378166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:03.379725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:03.387746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 597/1194] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:00:03.393072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.403373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a3bf8-c476-4258-89b0-12961e3ad2f1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.407774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.408584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.409492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.409768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] PATH_INFO: `/v3/users/4c391b2f54c040a29246386961b7ff60` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.410923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] RBAC: Authorizing `identity:get_user(user_id=4c391b2f54c040a29246386961b7ff60)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:03.413014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:03.414782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 598/1195] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/users/4c391b2f54c040a29246386961b7ff60 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:00:03.419802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.428697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d553d6-0d78-4929-b633-a07c8d22ddd7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.433128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.433764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.434125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.434477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.442060 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:03.443729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:03.452135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 598/1196] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:00:03.458010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.467335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691308e-3ebe-499b-af0b-d496af8cb330 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.472340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.473166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.473445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.473715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] PATH_INFO: `/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.474841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e5d1ad92d1954b0ab6948deff06a8f22)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:03.476801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab2aaa-254e-410b-9ea4-ce8fa51f41c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:03.478550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 599/1197] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/projects/e5d1ad92d1954b0ab6948deff06a8f22 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:00:03.483862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:00:03.492186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9de28d-a900-4cea-8814-5c87b3169104 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:00:03.496802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:00:03.497451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:00:03.497730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:00:03.498001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:00:03.498800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=e5d1ad92d1954b0ab6948deff06a8f22, user.id=4c391b2f54c040a29246386961b7ff60) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:00:03.499103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:00:03.500858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaca5e3-e686-41f6-9005-66a2610e541b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:00:03.506601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 599/1198] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 10:00:03 2022] GET /identity/v3/role_assignments?user.id=4c391b2f54c040a29246386961b7ff60&scope.project.id=e5d1ad92d1954b0ab6948deff06a8f22&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:04.768217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55843fd3-77cd-44aa-b30c-71b455fb2025 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:04.768217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55843fd3-77cd-44aa-b30c-71b455fb2025 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:04.768217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55843fd3-77cd-44aa-b30c-71b455fb2025 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:04.768217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 600/1199] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:04.773813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:04.774240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:04.774326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:04.792526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:04.794593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:04.804783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 600/1200] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:04.830203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55843fd3-77cd-44aa-b30c-71b455fb2025 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:04.843296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55843fd3-77cd-44aa-b30c-71b455fb2025 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:04.848387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:04.849285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:04.849564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:04.849844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:04.861835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:04.863949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:04.886952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:04.888188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 601/1201] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:04.897097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:04.907079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599857a4-553d-47e8-8ca4-747eea6c13fb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:04.912176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:04.912861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:04.913168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:04.913443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:04.914170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:04.914462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:04.916041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c9fbf-ed57-4bd2-accb-f8ba0db7ff30 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:04.934405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 601/1202] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:04.935569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:04.948599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b9ad8-b70b-4e21-96ec-897d9b78e5be admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:04.953494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:04.954215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:04.954493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:04.954792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:04.955445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:04.957355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430987e6-54b1-4738-98e5-a14045841ed5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:04.979700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 602/1203] 10.222.0.73 () {60 vars in 1153 bytes} [Mon Feb 21 10:01:04 2022] POST /identity/v3/users => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:01:07.542458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743ed7-3f89-4e31-b408-2b20aac4de68 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.543105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743ed7-3f89-4e31-b408-2b20aac4de68 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.543105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3743ed7-3f89-4e31-b408-2b20aac4de68 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.544785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 602/1204] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:07.551101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.551585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.551684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.570933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:07.572119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:07.580833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 603/1205] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:07.610590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743ed7-3f89-4e31-b408-2b20aac4de68 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.623727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3743ed7-3f89-4e31-b408-2b20aac4de68 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.628608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.629508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.629796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.630098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.645801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:07.653466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 10:01:07.654779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 603/1206] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:07.661785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.671199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d08f3b-d8f9-4803-ae81-ad2f6dd64518 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.676347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.677016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.677322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.677835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.678657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:07.678969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.680802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.689674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 604/1207] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:07.696184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.708347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561e577-910c-4967-a73b-bfd311378956 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.713214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.713998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.714394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.714547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.727345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.729757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.748416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:07.750587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 604/1208] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:07.756996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.767947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7778b-f0c4-4ccd-8efa-b4f36731a481 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.774412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.775252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.775606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.775910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.776878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:07.777215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.778776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.799056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 605/1209] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:07.800375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.810679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9265-2589-4d52-beb4-c9cc51dd1b51 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.816482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.817658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.817892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.818169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.826587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.828682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.845185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:07.852016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 605/1210] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:07.852798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.863755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab5974-5988-4ea8-aa25-4d198b0cc51d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.870323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.871436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.871962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.872693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.873879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:07.874311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.877152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.899035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 606/1211] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:07.905431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.915325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f84ef-8a5b-4017-a530-fd8d4bad2a81 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.921317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.922574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.922935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.923292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.931593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.933529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:07.944628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 606/1212] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:01:07.951379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:07.962086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263f720-5a9e-44d5-97af-7f33e37374b2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:07.967368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:07.968236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:07.968580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:07.968942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:07.979745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:07.982203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:08.000965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:08.002388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 607/1213] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:08.010813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:08.019063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c5658-a222-44d4-8d6f-25b29e7ca7ab admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:08.024992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:08.025680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:08.025983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:08.026291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:08.027307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:08.027721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:08.029571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:08.042746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 607/1214] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:08.049162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:08.059204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4673706-db69-4e91-b0a1-7f0cdd7d4495 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:08.064130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:08.064903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:08.065214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:08.065531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:08.074949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:08.076853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:08.090654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:08.092168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 608/1215] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:08.098394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:08.109205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7df640-9928-4d07-b733-8f9aea0a35a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:08.115475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:08.116258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:08.116569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:08.116960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:08.117907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:08.118252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:08.120314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba958a6-9130-4b40-860c-0aaa7cc2aa50 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:08.135794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 608/1216] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:08.141845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:08.153796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274319-6154-4562-aa1d-633788a97c43 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:08.159681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:08.160395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:08.161361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:08.161667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:08.162636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7275cff197074a10a2aad87fc5343248) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:08.162947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:08.164765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e26bb-f757-42e2-be3b-ef0996ddbe0a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:08.171209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 609/1217] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 10:01:08 2022] GET /identity/v3/role_assignments?user.id=7275cff197074a10a2aad87fc5343248&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:10.504177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051873-1e33-4d61-9dc7-964c8959dace None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.504717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051873-1e33-4d61-9dc7-964c8959dace None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.504717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67051873-1e33-4d61-9dc7-964c8959dace None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.506812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 609/1218] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:10.512652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.513124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.513235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.532709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:10.533989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:10.542367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 610/1219] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:10.567948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67051873-1e33-4d61-9dc7-964c8959dace None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.581546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67051873-1e33-4d61-9dc7-964c8959dace None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.586358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.587210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.587532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.587807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.599422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:10.606425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 10:01:10.607615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 610/1220] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:10.614862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.624499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca864a0d-2ed0-49d2-92c1-8dbedb918b7f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.632279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.633032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.634104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.634104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.634579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:10.634887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.636588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.648502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 611/1221] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:10.652077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.663362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946e7e-0073-4a73-8ba1-0e7a2d1e4a06 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.668489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.669339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.669620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.669900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.682486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.684351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.704516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:10.705919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 611/1222] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:10.711798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.722067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4c987-2114-4f44-a3cb-00620d7923e5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.726584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.727229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.727521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.727780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.728488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:10.728790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.730400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.743091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 612/1223] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:10.748824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.758801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07375563-1670-4dfc-aa93-02bb9ec1fb4b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.763259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.764057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.764334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.764603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.772872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.775024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.790073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:10.791487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 612/1224] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:10.797325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.807765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e01cff-3f96-4abc-841a-48216b93f932 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.820238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.821179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.821627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.822042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.823019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:10.823424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.825516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.848271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 613/1225] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:10.854158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.863976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf19697-dce5-4f76-a032-5106b84dfe23 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.869087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.869873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.870157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.870471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.882737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.885597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.905539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:10.907757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 613/1226] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:10.913334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.924643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145976d3-6845-4552-b5e1-59059799b8cb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.930349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.931315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.931444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.931712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.932440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:10.932763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.934495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.947880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 614/1227] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:10.954550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:10.965116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2378d9-c34b-439f-b07c-520a26e31b24 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:10.970954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:10.971907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:10.972270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:10.972649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:10.980322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:10.982456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:10.996254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:10.997680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 614/1228] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:11.003685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:11.014252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71ead2-10a1-4d5a-b4ae-16f1f77fe422 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:11.020001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:11.020960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:11.021683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:11.022156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:11.023366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:11.024000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:11.026489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735491a-0b1b-4196-98f3-2e2703398c3b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:11.043724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 615/1229] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:11.049359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:11.059944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f844-435a-49ba-b1bb-0dd76be9021a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:11.065485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:11.066501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:11.066882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:11.067253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/7275cff197074a10a2aad87fc5343248/roles/3e25a9609de34e39a36155c42ec3c7ab` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:11.082814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=7275cff197074a10a2aad87fc5343248, role_id=3e25a9609de34e39a36155c42ec3c7ab)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:11.086119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2ef76-4af8-4dc9-8652-5af6d0b24e3b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:11.104411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 615/1230] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 10:01:11 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/7275cff197074a10a2aad87fc5343248/roles/3e25a9609de34e39a36155c42ec3c7ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:01:13.626844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6e8-0a4d-4203-8b02-40b20df6cf68 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.627392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6e8-0a4d-4203-8b02-40b20df6cf68 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.627392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6e8-0a4d-4203-8b02-40b20df6cf68 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.629194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 616/1231] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:13.634865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.635403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.635403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.657663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:13.659033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:13.717742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 616/1232] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:13.742627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6e8-0a4d-4203-8b02-40b20df6cf68 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.757792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6e8-0a4d-4203-8b02-40b20df6cf68 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.762412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.763179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.763460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.763742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.774992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:13.783101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 21 10:01:13.784302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 617/1233] 10.222.0.73 () {56 vars in 1123 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:13.790918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.801810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6221fe5-91ea-43ae-a658-8a49b0999966 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.807176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.807914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.808241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.808521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.809351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:13.809658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:13.811338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:13.819786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 617/1234] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:13.825670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.838847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289144a-ae5a-4df2-b530-d4c6866f4541 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.844664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.845474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.845743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.846054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.856750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:13.858770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:13.878035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:13.879262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 618/1235] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:13.886050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.895950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aff-0715-4e40-9b03-6ca6b74241e1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.900934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.901803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.902113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.902413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.903112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:13.903415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:13.904980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:13.922777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 618/1236] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:13.923990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.935641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a33dc5-cdab-4486-bcb7-0eb4f0810b29 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.940856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.941671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.941949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.942222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.950802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:13.953513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:13.971360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:13.974052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 619/1237] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:13.979952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:13.990717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aed94-b3df-4314-af9b-182c2b9e1bb0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:13.995737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:13.996428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:13.996694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:13.996963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:13.997827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:13.998149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.000513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.019304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 619/1238] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:14.024900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.035941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cec31-e249-4ec4-a0b2-29272ffeaa5f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.040683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.041435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.041730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.041976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.050293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.052148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.061726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 620/1239] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:01:14.068723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.079666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6694098-dbb6-4644-b6ca-eb38966b9744 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.085309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.086094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.086374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.086646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.099299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.101719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.123287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:14.125148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 620/1240] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:14.131521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.141133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633a675-a6ce-4546-b1cd-c049a5f5b0c8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.146263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.146890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.147169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.147446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.148181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:14.148477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.150073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.162741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 621/1241] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:14.168429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.180218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98972a-2f57-4c11-8107-11cab9a6f8cf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.185327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.186108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.186396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.186667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.194115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.196166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.209681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:14.216427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 621/1242] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:14.217732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.228019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0af827-bcd0-46ca-bbd6-a0b9977834ba admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.233077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.233854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.234901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.235197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.236127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:14.236508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.238639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633ce10-eb61-47b3-a280-99745da1eea9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.252068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 622/1243] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:14.258241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:14.268380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f69bd0-b45a-4af1-991c-25fbf54b85ef admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:14.272921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:14.273668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:14.274009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:14.274344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:14.275226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] RBAC: Adding query filter params (role.id=3e25a9609de34e39a36155c42ec3c7ab, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7275cff197074a10a2aad87fc5343248) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:14.275599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:14.277673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1adb-1d6b-4d51-bfbb-a242652569ad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:14.285354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 622/1244] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 10:01:14 2022] GET /identity/v3/role_assignments?user.id=7275cff197074a10a2aad87fc5343248&scope.project.id=395510de8de542388e9d42e99270937b&role.id=3e25a9609de34e39a36155c42ec3c7ab => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:16.699989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3231-cad9-4be2-884e-060c830e48f0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.700563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3231-cad9-4be2-884e-060c830e48f0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.700563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d3231-cad9-4be2-884e-060c830e48f0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.702639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 623/1245] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:16.708290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.708734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.708827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.728043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:16.729250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:16.737518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 623/1246] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:01:16.762096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3231-cad9-4be2-884e-060c830e48f0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.775363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d3231-cad9-4be2-884e-060c830e48f0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:16.780423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:16.783579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.783857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.784121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.795866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:16.803186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 10:01:16.804672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 624/1247] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:16.810846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.820033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41656312-625b-4ab7-8aff-ab7638661cb6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:16.824656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:16.825348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.825625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.825890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.826663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:16.826940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:16.829028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:16.837704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 624/1248] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:16.844229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.855745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca955e4-d3ac-4f04-b5b8-ae24152fba61 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:16.860332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:16.861114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.861393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.861693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.871851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:16.873644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:16.890903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:16.892238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 625/1249] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:16.898017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.909317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a2fb0-7b52-4669-aee0-988db21774ff admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:16.913975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:16.914750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.915028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.915338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.916099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:16.916404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:16.918074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:16.930222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 625/1250] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:16.936662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.947320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c90d6-4e83-4b46-8cf5-1fd8764f93be admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:16.953560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:16.954448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:16.954858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:16.955240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:16.962970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:16.965463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:16.980892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:16.982219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 626/1251] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:16.988123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:16.999058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff41b-e149-4259-acde-fbf8c37e9cad admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.004808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.005920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.006278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.006685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.007640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:17.008058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.010320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.029942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 626/1252] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:17.036349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.046649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8e3db-bbd7-47b1-84a2-d1b6cce4bd07 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.051387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.051988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.052263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.052537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.060505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.062739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.071448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 627/1253] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:01:17.077405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.087551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec17760-6bbf-434a-b71a-ae1a4d1f6ed6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.092410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.093769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.093769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.093958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.104463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.106398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.126045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:17.128415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 627/1254] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:17.133749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.143891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a4cda-03bc-44b8-97ef-b3a77b73df9d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.149687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.150645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.151047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.151403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.152362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:17.152768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.154468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.167586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 628/1255] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:17.174002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.183847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33ae90-65c3-49bc-83ba-af7477825f12 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.189676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.190492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.190776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.191052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.199723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.201944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.215622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:17.216706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 628/1256] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:17.222721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.232593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97a40e-2a45-4b98-aecf-4773282c14da admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.237414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.238081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.238439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.238640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.239555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:17.239843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.241832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c00ba0-536b-40ad-8df9-ec183f50f3ff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.256558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 629/1257] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:17.263070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:17.275785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8e1b5-1853-4375-8ef5-43cf5968ea30 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:17.280714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:17.281999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:17.282280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:17.282553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:17.283377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7275cff197074a10a2aad87fc5343248) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:17.283978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:17.285975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072db011-858d-4c79-89e8-f301b1b820d2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:17.292352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 629/1258] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 10:01:17 2022] GET /identity/v3/role_assignments?user.id=7275cff197074a10a2aad87fc5343248&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:19.642639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3b28-9aba-47af-ac8a-cd224f9f66f0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.643235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3b28-9aba-47af-ac8a-cd224f9f66f0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.643235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3b28-9aba-47af-ac8a-cd224f9f66f0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.645039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 630/1259] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:19.650781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.651200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.651339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.670844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:19.672095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:19.681704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 630/1260] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:01:19.706237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e3b28-9aba-47af-ac8a-cd224f9f66f0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.720043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e3b28-9aba-47af-ac8a-cd224f9f66f0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.725780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.726719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.727084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.727476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.744378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:19.756216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 10:01:19.757707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 631/1261] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:19.764332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.774331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9bf9f-9068-4a12-84c8-56c83a120ed5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.779728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.780417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.780736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.781686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.782514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:19.782871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:19.784589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:19.793471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 631/1262] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:19.799542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.810609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72696-e222-4a4a-883d-811e059a57e6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.815958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.816862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.817196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.817496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.830639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:19.832486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:19.852307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:19.853830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 632/1263] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:19.859601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.870773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5ca5-8bcd-48cb-b6e8-de6e60f2f1bd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.877507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.878696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.879201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.879565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.880538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:19.880849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:19.882558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:19.895840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 632/1264] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:19.901592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.912125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd442971-40e7-4675-877d-664c0cc45e74 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.917078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.917884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.918161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.918508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.925681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:19.927891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:19.942149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:19.943420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 633/1265] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:19.949583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:19.960644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70484af-9ebf-42a9-a4d8-1ac1b1a7a327 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:19.965515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:19.966171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:19.966508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:19.966836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:19.967663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:19.967965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:19.970417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:19.990887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 633/1266] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:19.996712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:20.007059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64480f30-7aaf-4004-8d30-59d379b0a70b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:20.011761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:20.012543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:20.012825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:20.013114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:20.023934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:20.025804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:20.047365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:20.048655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 634/1267] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:20.054796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:20.068339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66886ac-f845-4571-bcbc-511fb36dfc1b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:20.073212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:20.073857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:20.074132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:20.074401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:20.075111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:20.075426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:20.077164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:20.090552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 634/1268] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:20.096338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:20.107314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aa578-71c5-49c3-bfd1-a6658c0f8586 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:20.112591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:20.113669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:20.114067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:20.114348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:20.123138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:20.126112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:20.143192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:20.144368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 635/1269] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:20.150211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:20.160989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7aa792-db59-47de-ba9d-b3d19e42f057 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:20.166317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:20.167115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:20.167399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:20.167676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:20.168463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:20.168772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:20.170680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad9d8c-1637-4d9d-bd44-0aeddd9a72df admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:20.185660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 635/1270] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:01:20.192830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:20.205811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8842a-bd44-4d42-9451-8eec7f0395a6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:20.211870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:20.212995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:20.213310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:20.213728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] PATH_INFO: `/v3/projects/395510de8de542388e9d42e99270937b/users/7275cff197074a10a2aad87fc5343248/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:20.216190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395510de8de542388e9d42e99270937b, user_id=7275cff197074a10a2aad87fc5343248, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:20.218852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7a22ec-a8da-4bc8-94e6-f38fe30579f3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:20.234052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 636/1271] 10.222.0.73 () {58 vars in 1460 bytes} [Mon Feb 21 10:01:20 2022] PUT /identity/v3/projects/395510de8de542388e9d42e99270937b/users/7275cff197074a10a2aad87fc5343248/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:01:22.868298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf84c7-91f6-4f01-bf5a-7ee5c9d98eeb None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:22.868815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf84c7-91f6-4f01-bf5a-7ee5c9d98eeb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:22.868928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf84c7-91f6-4f01-bf5a-7ee5c9d98eeb None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:22.870688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 636/1272] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:22.877204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:22.877708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:22.877799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:22.895458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:22.896630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:22.953224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 637/1273] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:01:22.976792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf84c7-91f6-4f01-bf5a-7ee5c9d98eeb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:22.988555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf84c7-91f6-4f01-bf5a-7ee5c9d98eeb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:22.992800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:22.993593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:22.993871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:22.994143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.003885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 21 10:01:23.010874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 21 10:01:23.011979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 637/1274] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Feb 21 10:01:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:23.017934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.026567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5e518-3bb9-4b09-9dc5-58e6c096e39a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.031762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.032395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.032673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.032943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.033877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.034182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.035749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.043675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 638/1275] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:23.048887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.058039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7f35e-8f40-457e-b0ea-adc17c253182 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.063028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.063756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.064029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.064296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.074429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.076196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.092199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:23.094096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 638/1276] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 21 10:01:23.099290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.108623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852724ed-be80-4f66-9034-8623e1718cc6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.113796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.114420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.114697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.114967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.115673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.115975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.117560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.129194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 639/1277] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:23.134779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.144148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0b4a2-25cf-4ea8-b447-162592d7178c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.148548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.149343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.149619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.149886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.158140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.160094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.173636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 21 10:01:23.174726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 639/1278] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:23.180198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.189463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e481c-39c9-467c-9bfd-b81a363661f0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.193906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.194536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.194816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.195089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.195918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.196220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.198126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.214605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 640/1279] 10.222.0.73 () {56 vars in 1164 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:23.220436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.229687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703122-230a-4cac-95ad-52535e690fd4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.234665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.235272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.235548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.235817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.243252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.244932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.253446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 640/1280] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:01:23.258792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.267966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852d428-3ae3-44b5-8364-07d9a5c7c344 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.272415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.273199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.273478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.273750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.284020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.285829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.304453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 21 10:01:23.305903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 641/1281] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:23.312206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.322007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f63b-f902-4171-8d29-3d50d11ae790 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.327337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.328024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.328348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.328661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.329446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.329756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.331512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.345228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 641/1282] 10.222.0.73 () {56 vars in 1130 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:23.350863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.362500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2748213-8411-426e-aa5d-fd01798c6d7a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.367002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.367756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.368034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.368301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.374841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.376731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.389352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING keystone.server.flask.application [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 21 10:01:23.390929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 642/1283] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:23.396385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.406470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe65c-a5dd-498e-81c5-e659726cb809 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.410942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.411574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.411854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.412127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.412901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.413246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.415058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bd10e-e575-435b-9117-2d9b712fe94b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.426448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 642/1284] 10.222.0.73 () {56 vars in 1169 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:23.431815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:23.442102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c12c-76dd-48d5-be27-c2d63bbe1a46 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:23.446512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:23.447119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:23.447394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:23.447659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:23.448477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] RBAC: Adding query filter params (role.id=408af600f9f04514bc0631f4887e6d97, scope.project.id=395510de8de542388e9d42e99270937b, user.id=7275cff197074a10a2aad87fc5343248) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:23.448779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:23.450594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed0f8-45c8-4813-80b4-68972d049bd6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:23.456667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 643/1285] 10.222.0.73 () {56 vars in 1395 bytes} [Mon Feb 21 10:01:23 2022] GET /identity/v3/role_assignments?user.id=7275cff197074a10a2aad87fc5343248&scope.project.id=395510de8de542388e9d42e99270937b&role.id=408af600f9f04514bc0631f4887e6d97 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:25.742511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f51a-8fd2-4ea8-b499-bb9a2d891382 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:25.743043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f51a-8fd2-4ea8-b499-bb9a2d891382 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:25.743043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302f51a-8fd2-4ea8-b499-bb9a2d891382 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:25.745119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 643/1286] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:25.750799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:25.751226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:25.751721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:25.770198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:25.771369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:25.779736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 644/1287] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:25.802347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302f51a-8fd2-4ea8-b499-bb9a2d891382 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:25.815061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302f51a-8fd2-4ea8-b499-bb9a2d891382 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:25.819380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:25.820150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:25.820429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:25.820696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:25.821372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:25.822928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:25.833512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 10:01:25.834601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 644/1288] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 10:01:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:25.840096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:25.848729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df34dc-0593-4479-865f-9cb7c7a84ddd None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:25.853169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:25.853798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:25.854070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:25.854336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:25.855025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:25.855325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:25.856874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27308156-b1f6-4873-8abf-2fd929be3b44 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:25.861988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 645/1289] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Feb 21 10:01:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:25.867212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:25.876939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c1e4-1588-476c-afe4-960a94b8ccc1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:25.881621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:25.882241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:25.882520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:25.882788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] PATH_INFO: `/v3/services` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:25.883469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:25.883768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:25.885309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa12c86-b6f8-4f11-a833-143fd2fef46b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:25.889479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 645/1290] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Feb 21 10:01:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:28.191843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156841-351e-4e27-aff5-814dcf1fbdc5 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:28.192384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156841-351e-4e27-aff5-814dcf1fbdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:28.192384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156841-351e-4e27-aff5-814dcf1fbdc5 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:28.194187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 646/1291] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:28.199182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ec34-01e9-4305-92ee-baf7aa253b07 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:28.199601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ec34-01e9-4305-92ee-baf7aa253b07 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:28.199735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22ec34-01e9-4305-92ee-baf7aa253b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:28.217691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ac22ec34-01e9-4305-92ee-baf7aa253b07 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:28.219475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ac22ec34-01e9-4305-92ee-baf7aa253b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:28.226994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 646/1292] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:01:28.249386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65156841-351e-4e27-aff5-814dcf1fbdc5 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:28.261598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65156841-351e-4e27-aff5-814dcf1fbdc5 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:28.266522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:28.267154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:28.267437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:28.267714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:28.268431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:28.270030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b4a5be-ae24-408c-bdc3-f2436a4730a8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:28.283070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 647/1293] 10.222.0.73 () {60 vars in 1162 bytes} [Mon Feb 21 10:01:28 2022] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:01:30.557341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110ba9-cfbc-4cb7-a687-2485113f2129 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.557937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110ba9-cfbc-4cb7-a687-2485113f2129 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.557937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110ba9-cfbc-4cb7-a687-2485113f2129 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.559675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 647/1294] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:30.564654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.565025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.565230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.582443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:30.583593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:30.600428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 648/1295] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:30 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:30.623782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110ba9-cfbc-4cb7-a687-2485113f2129 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:30.636008 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110ba9-cfbc-4cb7-a687-2485113f2129 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:30.640363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:30.641166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.641448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.641773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.642493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:30.644060 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:30.654838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 10:01:30.656483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 648/1296] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 10:01:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:30.662403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:30.671662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9fb93-d2b4-40fb-ac9c-f1740a8a3a45 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:30.676111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:30.676744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.677019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.677318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.678011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:30.678310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:30.679865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:30.684844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 649/1297] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Feb 21 10:01:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:30.690346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:30.699641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcc91-fba6-4342-914b-2e35dea08c25 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:30.704137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:30.704758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.705039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.705345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.706122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] RBAC: Adding query filter params (interface=public, service_id=7ad4f180394a48148224b67e7c20b526, region_id=RegionOne) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:30.706429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:30.707967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c3b9e-4dc4-4559-b257-4a1a124aa173 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:30.712830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 649/1298] 10.222.0.73 () {56 vars in 1272 bytes} [Mon Feb 21 10:01:30 2022] GET /identity/v3/endpoints?service_id=7ad4f180394a48148224b67e7c20b526&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:30.718395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:30.727593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e4a22-4b31-4a95-93d7-8e0a185370b5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:30.732130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:30.732746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:30.733025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:30.733334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:30.734617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:30.736141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c4769-501e-497e-8e2d-65ee6a01f8a7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:30.742782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 650/1299] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 10:01:30 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:01:33.028320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507529d4-6f53-4d5e-8f96-c7dd53af3c96 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:33.028843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507529d4-6f53-4d5e-8f96-c7dd53af3c96 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:33.028843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507529d4-6f53-4d5e-8f96-c7dd53af3c96 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:33.030681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 650/1300] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:01:33.036124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:33.036567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:33.036665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:33.053750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:01:33.054912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:01:33.063130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 651/1301] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:01:33 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:01:33.086145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507529d4-6f53-4d5e-8f96-c7dd53af3c96 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:33.098174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507529d4-6f53-4d5e-8f96-c7dd53af3c96 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:33.102527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:33.103292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:33.103572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:33.103841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:33.104485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:33.106095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:33.116710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING keystone.server.flask.application [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 21 10:01:33.117835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 651/1302] 10.222.0.73 () {56 vars in 1138 bytes} [Mon Feb 21 10:01:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 21 10:01:33.123642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:33.133548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc380235-3c8d-435d-8f70-5cabc3075456 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:33.138143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:33.138781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:33.139059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:33.139330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] PATH_INFO: `/v3/services` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:33.140607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:01:33.140913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:33.142517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaf152-fc26-4326-92af-a2917becca2f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:33.147431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 652/1303] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Feb 21 10:01:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:01:33.152836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:01:33.162781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c937c-3069-4926-81f6-9a21f9cc3dbe admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:01:33.167283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:01:33.167895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:01:33.168174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:01:33.168447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:01:33.169210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:01:33.170747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36fa827-c6fa-4bd5-9d67-ebfe126c897f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:01:33.189112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 652/1304] 10.222.0.73 () {60 vars in 1165 bytes} [Mon Feb 21 10:01:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:02:36.526733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:36.527644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:36.528631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:36.534401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 653/1305] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:36.535773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f0bbf-72b9-496c-9879-f592b404c71b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:36.536210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f0bbf-72b9-496c-9879-f592b404c71b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:36.536315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f0bbf-72b9-496c-9879-f592b404c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:36.647739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-572f0bbf-72b9-496c-9879-f592b404c71b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:36.649218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-572f0bbf-72b9-496c-9879-f592b404c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:36.773215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 653/1306] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:02:36.783492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:36.785253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:36.945071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dab8-1a58-425b-ab86-1cd7b7510663 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:37.039172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:37.039831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:37.040118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:37.040392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:37.041146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:37.043016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c875401-a83f-4f12-a0ef-2ccfc04f8ab9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:37.069122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 654/1307] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 10:02:36 2022] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:02:39.423090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9381-b623-4ae9-80b3-87e71b04d1e9 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:39.423652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9381-b623-4ae9-80b3-87e71b04d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:39.423652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d9381-b623-4ae9-80b3-87e71b04d1e9 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:39.425472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 654/1308] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:39.430785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880e72-d9c3-44b2-956d-86959345160f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:39.431220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880e72-d9c3-44b2-956d-86959345160f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:39.431374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880e72-d9c3-44b2-956d-86959345160f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:39.502939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-79880e72-d9c3-44b2-956d-86959345160f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:39.504143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-79880e72-d9c3-44b2-956d-86959345160f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:39.596845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 655/1309] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:39.647629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:39.648013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:39.648471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:39.650355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 655/1310] 10.222.0.73 () {54 vars in 964 bytes} [Mon Feb 21 10:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:39.656779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878f09-4af7-4416-9ae8-81bd1c0d0eb7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:39.657112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878f09-4af7-4416-9ae8-81bd1c0d0eb7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:39.657369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878f09-4af7-4416-9ae8-81bd1c0d0eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:39.736805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7d878f09-4af7-4416-9ae8-81bd1c0d0eb7 None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:39.738464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7d878f09-4af7-4416-9ae8-81bd1c0d0eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:39.817392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 656/1311] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Feb 21 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:39.826616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:39.828123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:39.989520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e79ed-b148-49f0-8f7e-e046a1253c07 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:40.067929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:40.068586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:40.068867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:40.069167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:40.070893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:40.192065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:40.193556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d711c-3c3e-49a4-a1f2-b4c0dac0001a service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:40.212414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 656/1312] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:02:42.787482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990850-8243-47b2-85c6-fe507763fcef None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:42.787996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990850-8243-47b2-85c6-fe507763fcef None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:42.788088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20990850-8243-47b2-85c6-fe507763fcef None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:42.789850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 657/1313] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:42.795510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2baaf8-f054-47ff-8fca-040639008c47 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:42.795914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2baaf8-f054-47ff-8fca-040639008c47 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:42.796065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2baaf8-f054-47ff-8fca-040639008c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:42.865433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-3f2baaf8-f054-47ff-8fca-040639008c47 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:42.866622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3f2baaf8-f054-47ff-8fca-040639008c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:42.957895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 657/1314] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:42.995437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990850-8243-47b2-85c6-fe507763fcef None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:42.996960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-20990850-8243-47b2-85c6-fe507763fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:43.095800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20990850-8243-47b2-85c6-fe507763fcef None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:43.171859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:43.172495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:43.172770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:43.173046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:43.174707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:43.277238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:43.279228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d6455c-1030-4825-8957-63dabbb54411 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:43.295918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 658/1315] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:02:45.871984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:45.872699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:45.872699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:45.874467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 658/1316] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:45.879918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2678c-0e2f-4963-a706-2e7becf74309 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:45.880347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2678c-0e2f-4963-a706-2e7becf74309 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:45.880746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2678c-0e2f-4963-a706-2e7becf74309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:45.942688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f9a2678c-0e2f-4963-a706-2e7becf74309 None None] MFA Rules not processed for user `55fd3295f7094a86a66e7d75f7c0728a`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:45.943870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f9a2678c-0e2f-4963-a706-2e7becf74309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:46.034727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 659/1317] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:46.073255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:46.075273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:46.174666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d023e-7f6a-4556-bddd-5dd8513b86ed None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:46.242869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:46.243501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:46.243778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:46.244050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:46.245679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:46.347969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:46.349407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0262f27-2606-48f8-84ea-f41eee610d90 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:46.366462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 659/1318] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:02:49.245599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:49.246147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:49.246242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:49.247972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 660/1319] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:49.253207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b422-d338-45ff-b20e-bbbfde52405e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:49.253675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b422-d338-45ff-b20e-bbbfde52405e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:49.253778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812b422-d338-45ff-b20e-bbbfde52405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:49.317388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a812b422-d338-45ff-b20e-bbbfde52405e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:49.318586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a812b422-d338-45ff-b20e-bbbfde52405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:49.410624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 660/1320] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:49.448604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:49.450752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:49.548264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29c91c-e948-49f0-949e-87e727c13b0f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:49.616381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:49.617001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:49.617354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:49.617570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:49.619210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:49.722133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:49.723480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac8c62-4477-4a37-813e-35925387b178 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:49.740950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 661/1321] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:02:52.705046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:52.705609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:52.705609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:52.707407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 661/1322] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:52.712646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032d2-71fa-4683-a4ba-19dae29b238c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:52.713042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032d2-71fa-4683-a4ba-19dae29b238c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:52.713240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c032d2-71fa-4683-a4ba-19dae29b238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:52.778740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-89c032d2-71fa-4683-a4ba-19dae29b238c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:52.779914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-89c032d2-71fa-4683-a4ba-19dae29b238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:52.872608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 662/1323] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:52.908890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:52.910555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:53.014384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722f79b-6aaf-4719-b2fd-5c345430f7e6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:53.085325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:53.085895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:53.086177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:53.086450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:53.088081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:53.195691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:53.197154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458bc53-c8bf-4724-92cc-0097e78b12b3 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:53.214406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 662/1324] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:02:55.562586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:55.563117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:55.563117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:55.564974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 663/1325] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:55.570285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0cb64-0dde-4b3f-8b32-e92d4621670e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:55.570707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0cb64-0dde-4b3f-8b32-e92d4621670e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:55.570838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0cb64-0dde-4b3f-8b32-e92d4621670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:55.636131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-aab0cb64-0dde-4b3f-8b32-e92d4621670e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:55.637919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-aab0cb64-0dde-4b3f-8b32-e92d4621670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:55.728697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 663/1326] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:55.764704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:55.766358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:55.863117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69cc9-ffb0-4275-80d4-4787975c2f0f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:55.934691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:55.935327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:55.935679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:55.935970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:55.937636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:56.043385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:56.044839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d633a6-c92c-479c-b1a7-7e058f717ee2 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:56.063550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 664/1327] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:02:58.431657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:58.432173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:58.432173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:58.434148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 664/1328] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:02:58.439513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd3e7-d1e6-4eb8-969a-52d307927de4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:58.440066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd3e7-d1e6-4eb8-969a-52d307927de4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:58.440066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bd3e7-d1e6-4eb8-969a-52d307927de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:58.504822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a08bd3e7-d1e6-4eb8-969a-52d307927de4 None None] MFA Rules not processed for user `55fd3295f7094a86a66e7d75f7c0728a`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:02:58.506049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a08bd3e7-d1e6-4eb8-969a-52d307927de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:58.600115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 665/1329] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:02:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:02:58.637766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:02:58.639283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:58.739529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d4c74-b25e-431b-982f-fa9ebeed0ca4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:02:58.808450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:02:58.809106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:02:58.809391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:02:58.809665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:02:58.811265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:02:58.920484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:02:58.921967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df17947-8f46-4ea0-be8c-1145af1314b3 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:02:58.939542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 665/1330] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:02:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:01.487530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77992-2e2f-40c4-a11c-ef7e75e2ff27 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:01.488016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77992-2e2f-40c4-a11c-ef7e75e2ff27 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:01.488016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a77992-2e2f-40c4-a11c-ef7e75e2ff27 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:01.489818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 666/1331] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:01.495160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530fa8-f220-4cbf-b8df-9809e6c57d17 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:01.495565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530fa8-f220-4cbf-b8df-9809e6c57d17 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:01.496223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b530fa8-f220-4cbf-b8df-9809e6c57d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:01.558799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1b530fa8-f220-4cbf-b8df-9809e6c57d17 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:01.559976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1b530fa8-f220-4cbf-b8df-9809e6c57d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:01.652685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 666/1332] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:01.706190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:01.706567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:01.706915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:01.708789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 667/1333] 10.222.0.73 () {54 vars in 964 bytes} [Mon Feb 21 10:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:01.715322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262102-d74c-4f16-be56-4f0e581fc82c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:01.715614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262102-d74c-4f16-be56-4f0e581fc82c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:01.715898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42262102-d74c-4f16-be56-4f0e581fc82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:01.795139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-42262102-d74c-4f16-be56-4f0e581fc82c None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:01.796360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-42262102-d74c-4f16-be56-4f0e581fc82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:01.878440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 667/1334] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Feb 21 10:03:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:01.887824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:01.889382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:01.994367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d679494-6909-4022-80a1-8bbba3360a50 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:02.073702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:02.074471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:02.074823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:02.075104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:02.076757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:02.196184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:02.197566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67257c4-bbd8-4c86-9353-5dde19f5b17f service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:02.216664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 668/1335] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:04.843223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:04.843743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:04.843743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:04.845537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 668/1336] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:04.850707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11426-7e3e-4a5f-be47-c01d233a3adc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:04.851092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11426-7e3e-4a5f-be47-c01d233a3adc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:04.851250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11426-7e3e-4a5f-be47-c01d233a3adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:04.931314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-67b11426-7e3e-4a5f-be47-c01d233a3adc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:04.932521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-67b11426-7e3e-4a5f-be47-c01d233a3adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:05.026090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 669/1337] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:05.066861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:05.068361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:05.168133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cda70-3c8c-4c67-89a2-8c2803787019 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:05.237828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:05.238477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:05.238758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:05.239032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:05.240664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:05.344887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:05.346368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244f24a-340a-4b57-aa47-c6cea582f381 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:05.363974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 669/1338] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:08.277001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:08.277591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:08.277734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:08.279660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 670/1339] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:08.285561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b3aa-9828-4999-acc5-2e19187fbbbe None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:08.286070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b3aa-9828-4999-acc5-2e19187fbbbe None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:08.286161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b3aa-9828-4999-acc5-2e19187fbbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:08.357215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8040b3aa-9828-4999-acc5-2e19187fbbbe None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:08.358426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8040b3aa-9828-4999-acc5-2e19187fbbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:08.458831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 670/1340] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:08.494330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:08.498289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:08.590532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc63464-2b85-4e2c-a0ef-7a32cd2499b4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:08.593988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:08.594616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:08.594895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:08.595167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:08.603720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:08.605686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca58cc6-cb75-4acd-8a91-d88971e86c4f service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:08.614613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 671/1341] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:12.963662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d4b3-1aaf-4246-acbd-2acdac773b1a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:12.964789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d4b3-1aaf-4246-acbd-2acdac773b1a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:12.964789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d4b3-1aaf-4246-acbd-2acdac773b1a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:12.966473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 671/1342] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:12.971690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682a51-dd7e-44a9-8220-a18b592d3839 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:12.972071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682a51-dd7e-44a9-8220-a18b592d3839 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:12.972240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31682a51-dd7e-44a9-8220-a18b592d3839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:12.999907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-31682a51-dd7e-44a9-8220-a18b592d3839 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:13.001107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-31682a51-dd7e-44a9-8220-a18b592d3839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:13.074460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 672/1343] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:13.113691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281d4b3-1aaf-4246-acbd-2acdac773b1a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:13.124409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281d4b3-1aaf-4246-acbd-2acdac773b1a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:13.127985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:13.128627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:13.128904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:13.129210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:13.139102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:13.140511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed0daf-d749-47e7-9d70-e6f560f85f73 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:13.149762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 672/1344] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:16.050857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864a9ff-bf2b-4de5-b416-aee68add8a9b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:16.051459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864a9ff-bf2b-4de5-b416-aee68add8a9b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:16.051459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864a9ff-bf2b-4de5-b416-aee68add8a9b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:16.053413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 673/1345] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:16.059409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cc2-d3fa-475d-9961-a6599f64e603 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:16.059855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cc2-d3fa-475d-9961-a6599f64e603 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:16.059975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cc2-d3fa-475d-9961-a6599f64e603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:16.077520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-aba52cc2-d3fa-475d-9961-a6599f64e603 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:16.078705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-aba52cc2-d3fa-475d-9961-a6599f64e603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:16.086494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 673/1346] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:16.124064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864a9ff-bf2b-4de5-b416-aee68add8a9b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:16.135039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864a9ff-bf2b-4de5-b416-aee68add8a9b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:16.138704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:16.139335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:16.139612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:16.139884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:16.148608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:16.150058 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90d8ee-21b9-4845-8a69-ec4489c2d226 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:16.159175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 674/1347] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:20.441174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645c16d-17e6-4f7e-8a0f-b5737e99c32c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:20.441673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645c16d-17e6-4f7e-8a0f-b5737e99c32c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:20.441673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645c16d-17e6-4f7e-8a0f-b5737e99c32c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:20.443442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 674/1348] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:20.449354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9f7a-8eb6-4eba-94c8-aa3fd1a571fa None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:20.449792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9f7a-8eb6-4eba-94c8-aa3fd1a571fa None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:20.449917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e9f7a-8eb6-4eba-94c8-aa3fd1a571fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:20.468088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6c8e9f7a-8eb6-4eba-94c8-aa3fd1a571fa None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:20.469333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6c8e9f7a-8eb6-4eba-94c8-aa3fd1a571fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:20.477255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 675/1349] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:20.518219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645c16d-17e6-4f7e-8a0f-b5737e99c32c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:20.530595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645c16d-17e6-4f7e-8a0f-b5737e99c32c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:20.534942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:20.535777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:20.536160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:20.536446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:20.545977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:20.547426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67de98-e0dd-4992-9711-98ebb221d66f service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:20.557109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 675/1350] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:25.763821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3dec-8a26-4980-9fc3-3772ba5dc322 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:25.764255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3dec-8a26-4980-9fc3-3772ba5dc322 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:25.764829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff3dec-8a26-4980-9fc3-3772ba5dc322 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:25.767383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 676/1351] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:03:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:25.773250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd003-26c0-416f-a6d2-08d8fa12d1d9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:25.774156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd003-26c0-416f-a6d2-08d8fa12d1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:25.774519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dd003-26c0-416f-a6d2-08d8fa12d1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:25.860466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-200dd003-26c0-416f-a6d2-08d8fa12d1d9 None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:25.862431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-200dd003-26c0-416f-a6d2-08d8fa12d1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:25.960157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 676/1352] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:03:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:30.364963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34fbce-1c3e-43e1-8f93-80de638c145e None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:30.365613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34fbce-1c3e-43e1-8f93-80de638c145e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:30.365613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34fbce-1c3e-43e1-8f93-80de638c145e None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:30.367519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 677/1353] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:30.373102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be97a-79e1-48b0-a11f-e9beaf43af7b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:30.373547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be97a-79e1-48b0-a11f-e9beaf43af7b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:30.373646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be97a-79e1-48b0-a11f-e9beaf43af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:30.392845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f89be97a-79e1-48b0-a11f-e9beaf43af7b None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:30.394251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f89be97a-79e1-48b0-a11f-e9beaf43af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:30.403453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 677/1354] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:03:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:31.877484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d25b-16da-4f15-97e3-3da65f73c92c None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:31.878001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d25b-16da-4f15-97e3-3da65f73c92c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:31.878001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d25b-16da-4f15-97e3-3da65f73c92c None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:31.880059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 678/1355] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:31.973420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223233-e2bd-4f29-8b9a-b5ede9927755 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:31.973952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223233-e2bd-4f29-8b9a-b5ede9927755 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:31.973952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36223233-e2bd-4f29-8b9a-b5ede9927755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:31.995156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-36223233-e2bd-4f29-8b9a-b5ede9927755 None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:31.996359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-36223233-e2bd-4f29-8b9a-b5ede9927755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:32.005117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 678/1356] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:03:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:35.720862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f68e6-4f71-40f8-8a74-b88f8835d3e8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:35.721415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f68e6-4f71-40f8-8a74-b88f8835d3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:35.721415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f68e6-4f71-40f8-8a74-b88f8835d3e8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:35.727077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 679/1357] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:35.728520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7b4f-dd2b-40ef-83f4-ef64b513bd19 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:35.728979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7b4f-dd2b-40ef-83f4-ef64b513bd19 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:35.729116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7b4f-dd2b-40ef-83f4-ef64b513bd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:35.748579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c9cc7b4f-dd2b-40ef-83f4-ef64b513bd19 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:35.749911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c9cc7b4f-dd2b-40ef-83f4-ef64b513bd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:35.758134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 679/1358] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:35.806195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa423-7199-4904-abe2-f8fccf1ea145 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:35.806490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa423-7199-4904-abe2-f8fccf1ea145 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:35.807290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faa423-7199-4904-abe2-f8fccf1ea145 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:35.809078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 680/1359] 10.222.0.73 () {54 vars in 961 bytes} [Mon Feb 21 10:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:35.815272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348f1a-45ff-4258-9cb6-b58a9cef7399 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:35.815658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348f1a-45ff-4258-9cb6-b58a9cef7399 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:35.816049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45348f1a-45ff-4258-9cb6-b58a9cef7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:35.866021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-45348f1a-45ff-4258-9cb6-b58a9cef7399 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:35.867869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-45348f1a-45ff-4258-9cb6-b58a9cef7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:35.963089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 680/1360] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Feb 21 10:03:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:35.971249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa423-7199-4904-abe2-f8fccf1ea145 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:35.985400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faa423-7199-4904-abe2-f8fccf1ea145 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:35.990851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:35.991483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:35.991783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:35.992033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:36.001750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:36.003633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968764e9-dd6c-4941-aaa0-30f336eef04b service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:36.015057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 681/1361] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:38.702061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b71de-d947-4ba5-8ce3-10ac64f94b39 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:38.702983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b71de-d947-4ba5-8ce3-10ac64f94b39 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:38.703440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b71de-d947-4ba5-8ce3-10ac64f94b39 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:38.705417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 681/1362] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:38.710544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7a18-58b6-4e02-8cfa-1f6584fa2345 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:38.710966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7a18-58b6-4e02-8cfa-1f6584fa2345 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:38.711071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7a18-58b6-4e02-8cfa-1f6584fa2345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:38.730374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-efff7a18-58b6-4e02-8cfa-1f6584fa2345 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:38.731678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-efff7a18-58b6-4e02-8cfa-1f6584fa2345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:38.740584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 682/1363] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:38.784392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b71de-d947-4ba5-8ce3-10ac64f94b39 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:38.798561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b71de-d947-4ba5-8ce3-10ac64f94b39 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:38.804073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:38.804700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:38.804977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:38.805290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:38.814064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:38.815889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb306a9-593b-4018-bcc9-4057111c1c7c service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:38.826815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 682/1364] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:41.489114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a410a9-cf33-4406-ac1c-fea133495eae None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:41.489681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a410a9-cf33-4406-ac1c-fea133495eae None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:41.489772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a410a9-cf33-4406-ac1c-fea133495eae None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:41.491812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 683/1365] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:41.497499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14829-8894-468f-93ee-34aa333f68ee None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:41.497980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14829-8894-468f-93ee-34aa333f68ee None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:41.498196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14829-8894-468f-93ee-34aa333f68ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:41.521721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9bf14829-8894-468f-93ee-34aa333f68ee None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:41.523567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9bf14829-8894-468f-93ee-34aa333f68ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:41.533665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 683/1366] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:41.581152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20729c-809f-42d8-b17e-47bdb8a98615 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:41.581433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20729c-809f-42d8-b17e-47bdb8a98615 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:41.581711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20729c-809f-42d8-b17e-47bdb8a98615 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:41.583485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 684/1367] 10.222.0.73 () {54 vars in 961 bytes} [Mon Feb 21 10:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:41.590780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc971e4-69f0-4caa-bac3-9dc8af19812d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:41.591141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc971e4-69f0-4caa-bac3-9dc8af19812d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:41.591531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc971e4-69f0-4caa-bac3-9dc8af19812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:41.610630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2fc971e4-69f0-4caa-bac3-9dc8af19812d None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:41.611982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2fc971e4-69f0-4caa-bac3-9dc8af19812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:41.622996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 684/1368] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Feb 21 10:03:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:41.631077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20729c-809f-42d8-b17e-47bdb8a98615 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:41.646785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20729c-809f-42d8-b17e-47bdb8a98615 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:41.654065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:41.654718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:41.655755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:41.655755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:41.665987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:41.667933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d2fd-b4e3-4322-b284-6f2b0c45dda8 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:41.678934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 685/1369] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:03:43.937948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655a95-140b-42ca-816a-765bc8befedc None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:43.938563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655a95-140b-42ca-816a-765bc8befedc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:43.938563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7655a95-140b-42ca-816a-765bc8befedc None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:43.940281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 685/1370] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:43.945649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f0d-892a-4bd7-9917-fea8af248403 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:43.946377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f0d-892a-4bd7-9917-fea8af248403 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:43.946829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc07f0d-892a-4bd7-9917-fea8af248403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:43.964855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-acc07f0d-892a-4bd7-9917-fea8af248403 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:43.966351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-acc07f0d-892a-4bd7-9917-fea8af248403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:43.974498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 686/1371] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:44.069414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9a782-7513-4609-b9ff-2e81ad9b77cc None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.069701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9a782-7513-4609-b9ff-2e81ad9b77cc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.070143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9a782-7513-4609-b9ff-2e81ad9b77cc None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.071934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 686/1372] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:44.077243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35088-f1f7-4357-9d9c-8cd71b258dc2 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.077530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35088-f1f7-4357-9d9c-8cd71b258dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.077987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a35088-f1f7-4357-9d9c-8cd71b258dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.096418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-28a35088-f1f7-4357-9d9c-8cd71b258dc2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:44.097632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-28a35088-f1f7-4357-9d9c-8cd71b258dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:44.106018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 687/1373] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:44.150920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9a782-7513-4609-b9ff-2e81ad9b77cc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:44.165154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9a782-7513-4609-b9ff-2e81ad9b77cc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:44.171423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:44.172059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.172338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.172610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.181225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:44.182825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84e601-f77d-4bbc-abb1-760af60e9de7 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:44.193554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 687/1374] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:44.232686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ca05e-3ce3-450f-bfa6-457dd9f4a3ad None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.232968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ca05e-3ce3-450f-bfa6-457dd9f4a3ad None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.233335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ca05e-3ce3-450f-bfa6-457dd9f4a3ad None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.235278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 688/1375] 10.222.0.73 () {54 vars in 963 bytes} [Mon Feb 21 10:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:44.240481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709de17b-6614-4b53-964d-8f5fe47e6908 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.240971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709de17b-6614-4b53-964d-8f5fe47e6908 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.241425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709de17b-6614-4b53-964d-8f5fe47e6908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.296822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-709de17b-6614-4b53-964d-8f5fe47e6908 None None] MFA Rules not processed for user `731b9e74f74e4b4898bb81851831be5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:44.298186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-709de17b-6614-4b53-964d-8f5fe47e6908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:44.364871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 688/1376] 10.222.0.73 () {58 vars in 1060 bytes} [Mon Feb 21 10:03:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:44.372864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ca05e-3ce3-450f-bfa6-457dd9f4a3ad None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:44.384251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ca05e-3ce3-450f-bfa6-457dd9f4a3ad None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:44.388396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:44.389220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:44.389564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:44.389902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:44.399644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:44.401972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec1afb-b3f9-4721-b37d-58a1910f1312 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:44.412602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 689/1377] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:03:46.562852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69b9b-bb02-470c-a017-37c9ea9d58ab None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:46.563373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69b9b-bb02-470c-a017-37c9ea9d58ab None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:46.563453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c69b9b-bb02-470c-a017-37c9ea9d58ab None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:46.565467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 689/1378] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:46.570658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd753e1-6403-47a7-a583-db12db9f63e7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:46.571066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd753e1-6403-47a7-a583-db12db9f63e7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:46.571385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd753e1-6403-47a7-a583-db12db9f63e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:46.589528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ecd753e1-6403-47a7-a583-db12db9f63e7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:46.590625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ecd753e1-6403-47a7-a583-db12db9f63e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:46.598195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 690/1379] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:03:46.643280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c69b9b-bb02-470c-a017-37c9ea9d58ab None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:46.657526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c69b9b-bb02-470c-a017-37c9ea9d58ab None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:46.662898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:46.663523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:46.663801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:46.664073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:46.671942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:46.673587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7993f-d250-4ed9-a087-a2699de70fe3 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:46.682589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 690/1380] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:49.043845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0725a6-20bf-441c-8b2e-542a94da1535 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:49.044367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0725a6-20bf-441c-8b2e-542a94da1535 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:49.044655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0725a6-20bf-441c-8b2e-542a94da1535 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:49.046768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 691/1381] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:49.051861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a59fa-fd09-437b-a68b-c0a3f2616b0e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:49.052296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a59fa-fd09-437b-a68b-c0a3f2616b0e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:49.052424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a59fa-fd09-437b-a68b-c0a3f2616b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:49.071838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e67a59fa-fd09-437b-a68b-c0a3f2616b0e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:49.073763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e67a59fa-fd09-437b-a68b-c0a3f2616b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:49.082248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 691/1382] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:49.127833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0725a6-20bf-441c-8b2e-542a94da1535 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:49.144127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0725a6-20bf-441c-8b2e-542a94da1535 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:49.149854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:49.151220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:49.151620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:49.151996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:49.164813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:49.166559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d17a4a-4801-4529-92f9-dc21fbfdd257 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:49.184679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 692/1383] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:51.546159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945eac-93cb-4275-8435-ac2a2a103f4f None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:51.546620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945eac-93cb-4275-8435-ac2a2a103f4f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:51.546720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99945eac-93cb-4275-8435-ac2a2a103f4f None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:51.548459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 692/1384] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:51.553615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63817c-743d-4058-86f8-c4df0833390d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:51.554036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63817c-743d-4058-86f8-c4df0833390d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:51.554036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63817c-743d-4058-86f8-c4df0833390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:51.571451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1e63817c-743d-4058-86f8-c4df0833390d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:51.572632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1e63817c-743d-4058-86f8-c4df0833390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:51.580659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 693/1385] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:51.624148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945eac-93cb-4275-8435-ac2a2a103f4f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:51.639279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99945eac-93cb-4275-8435-ac2a2a103f4f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:51.644687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:51.645464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:51.645918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:51.646332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:51.654580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:51.656610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f93df6-1cd9-48ed-b495-93d0c3637896 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:51.677230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 693/1386] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:03:54.275902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a448f-ab57-4eec-953d-8b69ee954057 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:54.276478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a448f-ab57-4eec-953d-8b69ee954057 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:54.276478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a448f-ab57-4eec-953d-8b69ee954057 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:54.278379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 694/1387] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:54.284750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37360-f318-4955-9380-702b67c0ae6b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:54.285206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37360-f318-4955-9380-702b67c0ae6b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:54.285370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab37360-f318-4955-9380-702b67c0ae6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:54.304199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-4ab37360-f318-4955-9380-702b67c0ae6b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:54.305499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4ab37360-f318-4955-9380-702b67c0ae6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:54.314580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 694/1388] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:54.366040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a448f-ab57-4eec-953d-8b69ee954057 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:54.382255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a448f-ab57-4eec-953d-8b69ee954057 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:54.387952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:54.388607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:54.388889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:54.389209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:54.397830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:54.399456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8d6de-8a3d-4a80-8912-2463df071910 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:54.409262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 695/1389] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:03:56.772712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26760-aa49-4a63-88c6-712a2a1a8729 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:56.773296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26760-aa49-4a63-88c6-712a2a1a8729 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:56.773296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f26760-aa49-4a63-88c6-712a2a1a8729 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:56.775699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 695/1390] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:56.781205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f2a7-46d7-481a-8d32-24468ec054ac None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:56.781699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f2a7-46d7-481a-8d32-24468ec054ac None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:56.781854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1f2a7-46d7-481a-8d32-24468ec054ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:56.799487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-12c1f2a7-46d7-481a-8d32-24468ec054ac None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:56.800655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-12c1f2a7-46d7-481a-8d32-24468ec054ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:56.809387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 696/1391] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:03:56.856925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26760-aa49-4a63-88c6-712a2a1a8729 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:56.874702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f26760-aa49-4a63-88c6-712a2a1a8729 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:56.881478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:56.882237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:56.882593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:56.882933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:56.892959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:56.894555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b932c-1dcc-4a8d-a327-2f6bedb28d2f service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:56.903979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 696/1392] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:03:59.348018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814c8-b889-4c5f-afc7-173f33da112a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:59.348679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814c8-b889-4c5f-afc7-173f33da112a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:59.348679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7814c8-b889-4c5f-afc7-173f33da112a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:59.350404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 697/1393] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:03:59.356304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c51c-f0d5-4730-aa79-7dbf80de94a2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:59.357294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c51c-f0d5-4730-aa79-7dbf80de94a2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:59.357294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568c51c-f0d5-4730-aa79-7dbf80de94a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:59.375650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8568c51c-f0d5-4730-aa79-7dbf80de94a2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:03:59.376826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8568c51c-f0d5-4730-aa79-7dbf80de94a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:03:59.385484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 697/1394] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:03:59.428128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7814c8-b889-4c5f-afc7-173f33da112a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:03:59.442056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7814c8-b889-4c5f-afc7-173f33da112a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:03:59.447968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:03:59.448586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:03:59.448862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:03:59.449160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:03:59.457009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:03:59.458574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34705f53-7868-437b-9751-8200cdf62dbb service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:03:59.468216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 698/1395] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:01.458883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3225d9-585a-4df7-aae9-fde6b57fee24 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.459406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3225d9-585a-4df7-aae9-fde6b57fee24 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.459406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3225d9-585a-4df7-aae9-fde6b57fee24 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.461336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 698/1396] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:01.467699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53565-8615-40b6-b263-50372629bd5b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.468211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53565-8615-40b6-b263-50372629bd5b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.468319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53565-8615-40b6-b263-50372629bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.486106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6ba53565-8615-40b6-b263-50372629bd5b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:01.487289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6ba53565-8615-40b6-b263-50372629bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:01.495719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 699/1397] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:01.551439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a08a-07be-426b-903b-8e344a42978e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.551724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a08a-07be-426b-903b-8e344a42978e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.551993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14a08a-07be-426b-903b-8e344a42978e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.553792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 699/1398] 10.222.0.73 () {54 vars in 962 bytes} [Mon Feb 21 10:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:01.559229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4506c-2735-4c39-9486-5d86f7950d8a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.559582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4506c-2735-4c39-9486-5d86f7950d8a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.559981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4506c-2735-4c39-9486-5d86f7950d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.607123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6cd4506c-2735-4c39-9486-5d86f7950d8a None None] MFA Rules not processed for user `9e0131ca364c4f3c98aa0f49f6013a94`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:01.608284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6cd4506c-2735-4c39-9486-5d86f7950d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:01.666966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 700/1399] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Feb 21 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:04:01.674572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14a08a-07be-426b-903b-8e344a42978e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:01.685985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14a08a-07be-426b-903b-8e344a42978e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:01.689548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:01.690171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.690447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.690715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.699637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:01.701033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a13df-af1c-4e52-9b29-d15e86b75749 service glance] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:01.710559 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 700/1400] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:01.778276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bb5e-2fd0-4914-99ae-aeba5189ffff None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.778667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bb5e-2fd0-4914-99ae-aeba5189ffff None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.779015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bb5e-2fd0-4914-99ae-aeba5189ffff None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.780984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 701/1401] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:01.786548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db83a7-9a7c-436d-a60a-f01a74a1bd9d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.786897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db83a7-9a7c-436d-a60a-f01a74a1bd9d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.787234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db83a7-9a7c-436d-a60a-f01a74a1bd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.805118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a6db83a7-9a7c-436d-a60a-f01a74a1bd9d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:01.806925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a6db83a7-9a7c-436d-a60a-f01a74a1bd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:01.814665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 701/1402] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:01.859318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bb5e-2fd0-4914-99ae-aeba5189ffff None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:01.874247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bb5e-2fd0-4914-99ae-aeba5189ffff None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:01.880218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:01.880848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:01.881160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:01.881431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:01.890780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:01.892466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505fbff-1422-41f4-9533-f01d9318983f service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:01.902377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 702/1403] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:02.137870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82083-6a99-44e5-9197-dec6ddd4eb4f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:02.138156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82083-6a99-44e5-9197-dec6ddd4eb4f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:02.138427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc82083-6a99-44e5-9197-dec6ddd4eb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:02.185390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0cc82083-6a99-44e5-9197-dec6ddd4eb4f None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:02.186560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0cc82083-6a99-44e5-9197-dec6ddd4eb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:02.247604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 702/1404] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:02.292926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cd8e-cfce-40f8-959f-a7c2534789ea None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:02.293258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cd8e-cfce-40f8-959f-a7c2534789ea None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:02.293534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3cd8e-cfce-40f8-959f-a7c2534789ea None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:02.295347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 703/1405] 10.222.0.73 () {54 vars in 942 bytes} [Mon Feb 21 10:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:02.301669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4dc1-b1e3-4f33-8618-a0688f064e79 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:02.301978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4dc1-b1e3-4f33-8618-a0688f064e79 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:02.302254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea4dc1-b1e3-4f33-8618-a0688f064e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:02.354611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-31ea4dc1-b1e3-4f33-8618-a0688f064e79 None None] MFA Rules not processed for user `4a55309bdafe4b12bd50bc6e944bb10c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:02.355790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-31ea4dc1-b1e3-4f33-8618-a0688f064e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:02.423682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 703/1406] 10.222.0.73 () {58 vars in 1039 bytes} [Mon Feb 21 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:02.433959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cd8e-cfce-40f8-959f-a7c2534789ea None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:02.447053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3cd8e-cfce-40f8-959f-a7c2534789ea None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:02.451900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:02.452523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:02.452802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:02.453099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:02.460739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:02.462372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf3710-8662-418f-af54-fa335deb03df service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:02.470148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 704/1407] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:04:04.344392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c284-d3a7-4010-b902-3ed999ce92a7 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:04.344951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c284-d3a7-4010-b902-3ed999ce92a7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:04.344951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8c284-d3a7-4010-b902-3ed999ce92a7 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:04.346733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 704/1408] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:04.352090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e568-8658-4ed7-bf8b-be98242e2c26 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:04.353463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e568-8658-4ed7-bf8b-be98242e2c26 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:04.354015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e568-8658-4ed7-bf8b-be98242e2c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:04.374109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c620e568-8658-4ed7-bf8b-be98242e2c26 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:04.375603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c620e568-8658-4ed7-bf8b-be98242e2c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:04.383790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 705/1409] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:04.428742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c284-d3a7-4010-b902-3ed999ce92a7 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:04.443372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8c284-d3a7-4010-b902-3ed999ce92a7 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:04.449132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:04.449765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:04.450147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:04.450424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:04.458590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:04.460168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515c574-d586-4f99-be59-2cb47efd9688 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:04.471813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 705/1410] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:25.190457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2527-bb63-4d71-a874-4a6a2db7cb00 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:25.191083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2527-bb63-4d71-a874-4a6a2db7cb00 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:25.191083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2527-bb63-4d71-a874-4a6a2db7cb00 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:25.192771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 706/1411] 10.222.0.73 () {54 vars in 918 bytes} [Mon Feb 21 10:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:25.198505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051fa4-bb8b-4a85-b625-d533be6b41d9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:25.198969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051fa4-bb8b-4a85-b625-d533be6b41d9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:25.199103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051fa4-bb8b-4a85-b625-d533be6b41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:25.216929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-cc051fa4-bb8b-4a85-b625-d533be6b41d9 None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:25.218123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-cc051fa4-bb8b-4a85-b625-d533be6b41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:25.226285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 706/1412] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Feb 21 10:04:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:25.240224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d137-2ff5-4bea-b399-26d84f474ceb None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:25.240507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d137-2ff5-4bea-b399-26d84f474ceb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:25.240786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154d137-2ff5-4bea-b399-26d84f474ceb None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:25.242579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 707/1413] 10.222.0.73 () {54 vars in 918 bytes} [Mon Feb 21 10:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:25.247597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb79b1-d294-4568-b406-e90baa618fb0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:25.247875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb79b1-d294-4568-b406-e90baa618fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:25.248172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb79b1-d294-4568-b406-e90baa618fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:25.266062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a2eb79b1-d294-4568-b406-e90baa618fb0 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:25.267210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a2eb79b1-d294-4568-b406-e90baa618fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:25.276091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 707/1414] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Feb 21 10:04:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:28.015893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287701b3-2586-454a-8b39-45aec302a78a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:28.016462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287701b3-2586-454a-8b39-45aec302a78a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:28.016462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287701b3-2586-454a-8b39-45aec302a78a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:28.018271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 708/1415] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:28.023442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489e6a-f780-4b95-8256-8e1b91d26ef8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:28.023870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489e6a-f780-4b95-8256-8e1b91d26ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:28.023998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489e6a-f780-4b95-8256-8e1b91d26ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:28.041819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5c489e6a-f780-4b95-8256-8e1b91d26ef8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:28.042988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5c489e6a-f780-4b95-8256-8e1b91d26ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:28.050616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 708/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:28.091709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287701b3-2586-454a-8b39-45aec302a78a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:28.106234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287701b3-2586-454a-8b39-45aec302a78a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:28.111535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:28.112161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:28.112438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:28.112710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:28.121197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:28.122761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655b1c-93bd-4ef7-b3d7-2a247b7fc718 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:28.132139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 709/1417] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:29.474720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65cdec-4332-4f58-ac25-4e3702e01e05 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:29.475246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65cdec-4332-4f58-ac25-4e3702e01e05 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:29.475246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65cdec-4332-4f58-ac25-4e3702e01e05 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:29.476969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 709/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:29.482454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff175-e929-44da-ba8d-bfb09600a3aa None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:29.482904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff175-e929-44da-ba8d-bfb09600a3aa None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:29.483007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff175-e929-44da-ba8d-bfb09600a3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:29.500859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ff3ff175-e929-44da-ba8d-bfb09600a3aa None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:29.502045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ff3ff175-e929-44da-ba8d-bfb09600a3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:29.509859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 710/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:29.665385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65cdec-4332-4f58-ac25-4e3702e01e05 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:29.680111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65cdec-4332-4f58-ac25-4e3702e01e05 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:29.686155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:29.686778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:29.687061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:29.687337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:29.695229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:29.696794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41e897-09c2-4914-ac96-335769cefaa9 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:29.705907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 710/1420] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:31.037825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d26c7-5c8a-4549-a12a-6933b865ceb9 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:31.038369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d26c7-5c8a-4549-a12a-6933b865ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:31.038369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d26c7-5c8a-4549-a12a-6933b865ceb9 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:31.040164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 711/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:31.045361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46740a0-8c94-40d4-9e8d-06b86541cd62 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:31.045774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46740a0-8c94-40d4-9e8d-06b86541cd62 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:31.045919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46740a0-8c94-40d4-9e8d-06b86541cd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:31.063458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c46740a0-8c94-40d4-9e8d-06b86541cd62 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:31.064631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c46740a0-8c94-40d4-9e8d-06b86541cd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:31.072801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 711/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:31.221999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d26c7-5c8a-4549-a12a-6933b865ceb9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:31.236442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d26c7-5c8a-4549-a12a-6933b865ceb9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:31.241830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:31.242444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:31.242721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:31.242992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:31.250726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:31.252266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215aeb43-5d0d-4cda-b968-8372e5d7a009 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:31.261651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 712/1423] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:32.554490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fcc0-15eb-4a11-ab8c-b7c2d8c44e7e None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:32.555028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fcc0-15eb-4a11-ab8c-b7c2d8c44e7e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:32.555154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800fcc0-15eb-4a11-ab8c-b7c2d8c44e7e None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:32.556888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 712/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:32.561709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e29f-6cd9-424f-9bb6-b36ff22bebd9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:32.562148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e29f-6cd9-424f-9bb6-b36ff22bebd9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:32.562251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580e29f-6cd9-424f-9bb6-b36ff22bebd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:32.580773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4580e29f-6cd9-424f-9bb6-b36ff22bebd9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:32.582006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4580e29f-6cd9-424f-9bb6-b36ff22bebd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:32.590561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 713/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:32.738106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800fcc0-15eb-4a11-ab8c-b7c2d8c44e7e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:32.752638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800fcc0-15eb-4a11-ab8c-b7c2d8c44e7e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:32.758241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:32.758867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:32.759146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:32.760020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:32.767863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:32.769462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8820a2-3d59-4374-8f3e-de9a7c7b0c4e service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:32.778485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 713/1426] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:34.082338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a222cc-df6e-4395-a654-a03edee49be0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:34.082901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a222cc-df6e-4395-a654-a03edee49be0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:34.083017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a222cc-df6e-4395-a654-a03edee49be0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:34.084761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 714/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:34.090549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d85a4-9e8f-485e-a522-ae304774948e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:34.091000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d85a4-9e8f-485e-a522-ae304774948e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:34.091141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d85a4-9e8f-485e-a522-ae304774948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:34.110195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a38d85a4-9e8f-485e-a522-ae304774948e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:34.111376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a38d85a4-9e8f-485e-a522-ae304774948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:34.119942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 714/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:34.268092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a222cc-df6e-4395-a654-a03edee49be0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:34.282482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a222cc-df6e-4395-a654-a03edee49be0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:34.287760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:34.288374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:34.288650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:34.288918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:34.297548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:34.299097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009cbcc4-4a25-4c41-a1eb-7160a71f90e9 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:34.308144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 715/1429] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:35.554300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a987-673b-4346-8ed5-545d06e16af9 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:35.554903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a987-673b-4346-8ed5-545d06e16af9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:35.554903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974a987-673b-4346-8ed5-545d06e16af9 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:35.556628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 715/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:35.561678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57426-974f-429f-a07c-4fc14719d587 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:35.562126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57426-974f-429f-a07c-4fc14719d587 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:35.562232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd57426-974f-429f-a07c-4fc14719d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:35.580097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fbd57426-974f-429f-a07c-4fc14719d587 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:35.581288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fbd57426-974f-429f-a07c-4fc14719d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:35.589510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 716/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:04:35.738249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a987-673b-4346-8ed5-545d06e16af9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:35.752648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974a987-673b-4346-8ed5-545d06e16af9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:35.758244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:35.758865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:35.759144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:35.760069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:35.767843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:35.769426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779dce9-eda1-48cd-8f1e-6bce1219396a service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:35.778384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 716/1432] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:37.025952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf4cf-b292-4b96-a72b-54482c06bac8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:37.026528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf4cf-b292-4b96-a72b-54482c06bac8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:37.026528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bf4cf-b292-4b96-a72b-54482c06bac8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:37.028353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 717/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:37.033291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6252b-7722-4139-897a-c6d83abc4cdf None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:37.033697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6252b-7722-4139-897a-c6d83abc4cdf None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:37.033844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6252b-7722-4139-897a-c6d83abc4cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:37.051582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5da6252b-7722-4139-897a-c6d83abc4cdf None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:37.052745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5da6252b-7722-4139-897a-c6d83abc4cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:37.060362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 717/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:37.211156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf4cf-b292-4b96-a72b-54482c06bac8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:37.225788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bf4cf-b292-4b96-a72b-54482c06bac8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:37.231138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:37.231757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:37.232038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:37.232313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:37.240121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:37.241714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff0aae-f091-4962-b42d-b4c87b0d9975 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:37.251301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 718/1435] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:38.506748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5759-16da-4ea1-aca7-4697d7b80f7f None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:38.507291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5759-16da-4ea1-aca7-4697d7b80f7f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:38.507291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa5759-16da-4ea1-aca7-4697d7b80f7f None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:38.509088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 718/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:38.514542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066cfe-0224-4a0a-82f3-6a851ebe8fb8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:38.515018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066cfe-0224-4a0a-82f3-6a851ebe8fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:38.515115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9066cfe-0224-4a0a-82f3-6a851ebe8fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:38.533455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d9066cfe-0224-4a0a-82f3-6a851ebe8fb8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:38.534641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d9066cfe-0224-4a0a-82f3-6a851ebe8fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:38.542791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 719/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:38.694327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa5759-16da-4ea1-aca7-4697d7b80f7f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:38.708720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa5759-16da-4ea1-aca7-4697d7b80f7f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:38.715445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:38.716077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:38.716360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:38.716636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:38.724649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:38.726328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d478e7-de50-4fde-972c-04c5452ec3de service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:38.735830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 719/1438] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:39.977332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eac0-41f2-4105-8c98-20b0cda15481 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:39.977909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eac0-41f2-4105-8c98-20b0cda15481 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:39.977909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805eac0-41f2-4105-8c98-20b0cda15481 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:39.979659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 720/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:39.984538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87699-05bb-4b25-bb63-41a020a45e2b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:39.984975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87699-05bb-4b25-bb63-41a020a45e2b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:39.985108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87699-05bb-4b25-bb63-41a020a45e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:40.002579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1cb87699-05bb-4b25-bb63-41a020a45e2b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:40.004063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1cb87699-05bb-4b25-bb63-41a020a45e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:40.012288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 720/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:40.166253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805eac0-41f2-4105-8c98-20b0cda15481 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:40.180338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805eac0-41f2-4105-8c98-20b0cda15481 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:40.186043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:40.186667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:40.186945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:40.187235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:40.195223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:40.197330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81685992-8a29-4500-a5aa-e27b95c23ce5 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:40.206293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 721/1441] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:42.387468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b047d4-de79-42fe-8ac0-b554cd34f82a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:42.387997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b047d4-de79-42fe-8ac0-b554cd34f82a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:42.387997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b047d4-de79-42fe-8ac0-b554cd34f82a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:42.389750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 721/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:42.394947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446394-e9e3-4f82-a971-a5b037844363 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:42.395376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446394-e9e3-4f82-a971-a5b037844363 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:42.395491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446394-e9e3-4f82-a971-a5b037844363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:42.412613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-90446394-e9e3-4f82-a971-a5b037844363 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:42.413836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-90446394-e9e3-4f82-a971-a5b037844363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:42.421978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 722/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:42.463856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b047d4-de79-42fe-8ac0-b554cd34f82a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:42.474237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b047d4-de79-42fe-8ac0-b554cd34f82a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:42.478464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:42.479096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:42.479375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:42.479650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:42.488210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:42.489666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e8ef9-9ec9-4962-a7c1-32de9a5641d7 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:42.498633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 722/1444] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:44.987217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:44.987726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:44.987726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:44.989537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 723/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:44.995135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eacd7-9fac-4246-bf9c-cde2e20da422 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:44.995564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eacd7-9fac-4246-bf9c-cde2e20da422 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:44.995687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eacd7-9fac-4246-bf9c-cde2e20da422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:45.013947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-aa8eacd7-9fac-4246-bf9c-cde2e20da422 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:45.015127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-aa8eacd7-9fac-4246-bf9c-cde2e20da422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:45.022859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 723/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:45.060182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:45.061854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:45.075262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a1a09-440b-4a59-a719-e7c0122310b8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:45.078730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:45.079347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:45.079620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:45.079896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:45.088489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:45.089954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb89be8-7788-4ec1-9f9b-31b0d36a2a68 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:45.099413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 724/1447] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:47.693207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1825-9c03-498b-bb49-e24c47f2f2be None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:47.693808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1825-9c03-498b-bb49-e24c47f2f2be None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:47.693808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1825-9c03-498b-bb49-e24c47f2f2be None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:47.695574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 724/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:47.701284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdbc5-13cf-4e94-821c-6064a88c9c3e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:47.701688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdbc5-13cf-4e94-821c-6064a88c9c3e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:47.701839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdbc5-13cf-4e94-821c-6064a88c9c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:47.719881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-65fcdbc5-13cf-4e94-821c-6064a88c9c3e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:47.721030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-65fcdbc5-13cf-4e94-821c-6064a88c9c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:47.728623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 725/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:47.767170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1825-9c03-498b-bb49-e24c47f2f2be None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:47.777784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1825-9c03-498b-bb49-e24c47f2f2be None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:47.781253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:47.781876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:47.782156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:47.782427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:47.790980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:47.792382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd4c1f-ff78-4a88-bddb-3d9169060484 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:47.801454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 725/1450] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:50.772057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b79a84-2bc0-4e97-8395-f4ec949304d7 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:50.772617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b79a84-2bc0-4e97-8395-f4ec949304d7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:50.772617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b79a84-2bc0-4e97-8395-f4ec949304d7 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:50.774980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 726/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:50.780520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a575-0e2f-446f-b42a-23c958813cf4 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:50.780946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a575-0e2f-446f-b42a-23c958813cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:50.781109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3a575-0e2f-446f-b42a-23c958813cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:50.799108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e8b3a575-0e2f-446f-b42a-23c958813cf4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:50.800306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e8b3a575-0e2f-446f-b42a-23c958813cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:50.808100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 726/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:50.847900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b79a84-2bc0-4e97-8395-f4ec949304d7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:50.859197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b79a84-2bc0-4e97-8395-f4ec949304d7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:50.862737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:50.863362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:50.863644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:50.863916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:50.872757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:50.874214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f17bf-8200-4633-8da9-b9742a668634 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:50.883656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 727/1453] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:53.248253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ff72-c86b-4d9e-96b1-518010ab16ba None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:53.248789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ff72-c86b-4d9e-96b1-518010ab16ba None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:53.248911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0ff72-c86b-4d9e-96b1-518010ab16ba None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:53.250879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 727/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:53.256559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fd7a-04b1-49a3-a623-54403094d4c1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:53.256970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fd7a-04b1-49a3-a623-54403094d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:53.257154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088fd7a-04b1-49a3-a623-54403094d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:53.275077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b088fd7a-04b1-49a3-a623-54403094d4c1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:53.276257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b088fd7a-04b1-49a3-a623-54403094d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:53.283959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 728/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:53.322277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0ff72-c86b-4d9e-96b1-518010ab16ba None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:53.333491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0ff72-c86b-4d9e-96b1-518010ab16ba None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:53.337042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:53.337698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:53.337976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:53.338265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:53.347490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:53.348831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ebd95-eec8-484b-a292-ca830903e4fa service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:53.358489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 728/1456] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:55.740593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964e8c-b599-44ee-9ade-118dfd58bf5b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:55.741193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964e8c-b599-44ee-9ade-118dfd58bf5b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:55.741193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964e8c-b599-44ee-9ade-118dfd58bf5b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:55.742998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 729/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:55.748336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ee24-c208-447b-ac3d-294cb90badf0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:55.748737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ee24-c208-447b-ac3d-294cb90badf0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:55.748898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84ee24-c208-447b-ac3d-294cb90badf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:55.767200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ab84ee24-c208-447b-ac3d-294cb90badf0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:55.768445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ab84ee24-c208-447b-ac3d-294cb90badf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:55.776739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 729/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:55.822238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964e8c-b599-44ee-9ade-118dfd58bf5b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:55.832544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964e8c-b599-44ee-9ade-118dfd58bf5b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:55.836093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:55.837333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:55.837614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:55.837886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:55.846449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:55.847847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c749a-f4b2-4af7-badb-223c3611690e service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:55.856971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 730/1459] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:04:58.203534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263a6f-0331-4abb-85a8-6f73327a3ad6 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:58.204084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263a6f-0331-4abb-85a8-6f73327a3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:58.204084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa263a6f-0331-4abb-85a8-6f73327a3ad6 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:58.205902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 730/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:04:58.211155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf8ff-7979-4800-b0c2-152956419c49 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:58.211587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf8ff-7979-4800-b0c2-152956419c49 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:58.211777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cf8ff-7979-4800-b0c2-152956419c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:58.230088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-5f3cf8ff-7979-4800-b0c2-152956419c49 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:04:58.231254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5f3cf8ff-7979-4800-b0c2-152956419c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:04:58.239127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 731/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:04:58.275609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa263a6f-0331-4abb-85a8-6f73327a3ad6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:04:58.285883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa263a6f-0331-4abb-85a8-6f73327a3ad6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:04:58.289320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:04:58.289939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:04:58.290215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:04:58.290485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:04:58.299683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:04:58.301125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510c27f-d598-4101-b628-7aaf17395062 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:04:58.310114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 731/1462] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:00.630007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e002-9693-4edf-ae95-820176e8a345 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:00.630545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e002-9693-4edf-ae95-820176e8a345 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:00.630545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e002-9693-4edf-ae95-820176e8a345 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:00.632327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 732/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:00.637646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95921-1eb1-4d84-8353-d87601dcb018 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:00.638071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95921-1eb1-4d84-8353-d87601dcb018 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:00.638203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f95921-1eb1-4d84-8353-d87601dcb018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:00.656338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-30f95921-1eb1-4d84-8353-d87601dcb018 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:00.657561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-30f95921-1eb1-4d84-8353-d87601dcb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:00.665292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 732/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:00.702064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1e002-9693-4edf-ae95-820176e8a345 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:00.712381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1e002-9693-4edf-ae95-820176e8a345 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:00.716446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:00.717079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:00.717365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:00.717641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:00.726210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:00.727647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096d80a-09d3-4d91-87d7-d014f3aed011 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:00.737214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 733/1465] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:05:03.048425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d298-a26e-40d9-abb7-c1041b068e5c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:03.048983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d298-a26e-40d9-abb7-c1041b068e5c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:03.048983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809d298-a26e-40d9-abb7-c1041b068e5c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:03.050768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 733/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:03.056013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40499-788c-49f4-bdd6-48707f580459 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:03.056487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40499-788c-49f4-bdd6-48707f580459 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:03.056586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40499-788c-49f4-bdd6-48707f580459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:03.074430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d6a40499-788c-49f4-bdd6-48707f580459 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:03.075592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d6a40499-788c-49f4-bdd6-48707f580459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:03.087334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 734/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:03.131118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809d298-a26e-40d9-abb7-c1041b068e5c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:03.142129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809d298-a26e-40d9-abb7-c1041b068e5c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:03.145583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:03.146202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:03.146478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:03.146748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:03.155893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:03.157324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0bb59-a0e4-4d33-85a1-76ab02a6e643 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:03.166319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 734/1468] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:05.477167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281cc23-3b41-41fa-ae0d-102387028d70 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:05.477730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281cc23-3b41-41fa-ae0d-102387028d70 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:05.477730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281cc23-3b41-41fa-ae0d-102387028d70 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:05.479381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 735/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:05.484797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efec8c-262b-4ba4-9cef-08f0fb2a7232 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:05.485235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efec8c-262b-4ba4-9cef-08f0fb2a7232 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:05.485376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efec8c-262b-4ba4-9cef-08f0fb2a7232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:05.502869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-85efec8c-262b-4ba4-9cef-08f0fb2a7232 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:05.504301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-85efec8c-262b-4ba4-9cef-08f0fb2a7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:05.512555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 735/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:05.548295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281cc23-3b41-41fa-ae0d-102387028d70 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:05.558908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281cc23-3b41-41fa-ae0d-102387028d70 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:05.562373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:05.563021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:05.563293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:05.563562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:05.572673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:05.574094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b35d4-3c0b-44db-8afd-df562c08d8df service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:05.583035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 736/1471] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:26.069206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081285-e67d-4928-9a87-3f7da43c77b2 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:26.069810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081285-e67d-4928-9a87-3f7da43c77b2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:26.069810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42081285-e67d-4928-9a87-3f7da43c77b2 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:26.071570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 736/1472] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:26.076692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fd4f-d29e-497c-9429-486799dcc886 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:26.077174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fd4f-d29e-497c-9429-486799dcc886 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:26.077285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fd4f-d29e-497c-9429-486799dcc886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:26.098582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e031fd4f-d29e-497c-9429-486799dcc886 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:26.099788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e031fd4f-d29e-497c-9429-486799dcc886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:26.108239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 737/1473] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:26.154290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e100d-b453-4a03-9ffd-ee2265ad2f4f None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:26.154584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e100d-b453-4a03-9ffd-ee2265ad2f4f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:26.154860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e100d-b453-4a03-9ffd-ee2265ad2f4f None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:26.156609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 737/1474] 10.222.0.73 () {54 vars in 962 bytes} [Mon Feb 21 10:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:26.161287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed93a-1f2a-46eb-8232-0854ae2a8d6c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:26.161578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed93a-1f2a-46eb-8232-0854ae2a8d6c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:26.161855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed93a-1f2a-46eb-8232-0854ae2a8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:26.179332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fb7ed93a-1f2a-46eb-8232-0854ae2a8d6c None None] MFA Rules not processed for user `9e0131ca364c4f3c98aa0f49f6013a94`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:26.180999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fb7ed93a-1f2a-46eb-8232-0854ae2a8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:26.187339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 738/1475] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Feb 21 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:26.194128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e100d-b453-4a03-9ffd-ee2265ad2f4f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:26.204862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e100d-b453-4a03-9ffd-ee2265ad2f4f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:26.208341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:26.208949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:26.209255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:26.209527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:26.218311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:26.219708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7f728-eeef-454f-a83d-7ef6e7b704cb service glance] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:26.228620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 738/1476] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:28.600641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648464-d7bc-48c2-a55c-6b2ce5fd5ebc None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:28.601101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648464-d7bc-48c2-a55c-6b2ce5fd5ebc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:28.601222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb648464-d7bc-48c2-a55c-6b2ce5fd5ebc None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:28.603071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 739/1477] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:28.608150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b238-9461-4066-97d2-b6bd9d2e575d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:28.608541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b238-9461-4066-97d2-b6bd9d2e575d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:28.608715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b238-9461-4066-97d2-b6bd9d2e575d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:28.626152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-4de1b238-9461-4066-97d2-b6bd9d2e575d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:28.627333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4de1b238-9461-4066-97d2-b6bd9d2e575d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:28.635893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 739/1478] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:28.659552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb648464-d7bc-48c2-a55c-6b2ce5fd5ebc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:28.671562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb648464-d7bc-48c2-a55c-6b2ce5fd5ebc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:28.676790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:28.677460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:28.677737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:28.678004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:28.678721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:28.680518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6a8c-967f-4c50-9e2b-bc69d60bd37f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:28.694062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 740/1479] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Feb 21 10:05:28 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:05:30.999424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e463c4-68a2-43ba-8b42-a9aec30ff40a None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:30.999937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e463c4-68a2-43ba-8b42-a9aec30ff40a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:30.999937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e463c4-68a2-43ba-8b42-a9aec30ff40a None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:31.001691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 740/1480] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:31.006982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed20d-542d-42e2-9f2c-db53f51c4c41 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:31.007400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed20d-542d-42e2-9f2c-db53f51c4c41 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:31.007530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ed20d-542d-42e2-9f2c-db53f51c4c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:31.024805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-5e9ed20d-542d-42e2-9f2c-db53f51c4c41 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:31.026021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5e9ed20d-542d-42e2-9f2c-db53f51c4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:31.033754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 741/1481] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:31.076903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e463c4-68a2-43ba-8b42-a9aec30ff40a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:31.090951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e463c4-68a2-43ba-8b42-a9aec30ff40a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:31.096230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:31.096878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:31.097192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:31.097472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:31.106168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:31.107717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace41823-0c6b-4805-827d-6ead96763cb0 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:31.116823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 741/1482] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:33.565733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c8df-488b-419e-80af-552f6e6bddff None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:33.566355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c8df-488b-419e-80af-552f6e6bddff None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:33.566355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c8df-488b-419e-80af-552f6e6bddff None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:33.568137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 742/1483] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:33.573474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104091-ea1a-4954-a2fd-02ee4bc413dc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:33.573924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104091-ea1a-4954-a2fd-02ee4bc413dc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:33.574022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5104091-ea1a-4954-a2fd-02ee4bc413dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:33.591917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c5104091-ea1a-4954-a2fd-02ee4bc413dc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:33.593107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c5104091-ea1a-4954-a2fd-02ee4bc413dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:33.600645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 742/1484] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:33.636438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c8df-488b-419e-80af-552f6e6bddff None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:33.647071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c8df-488b-419e-80af-552f6e6bddff None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:33.651068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:33.651690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:33.651972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:33.652246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:33.660932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:33.662387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2628f2-9704-413a-99aa-f2a1bc0a9d78 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:33.672309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 743/1485] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:35.991682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323e47-9fea-414e-a975-ae75e40c7660 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:35.992078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323e47-9fea-414e-a975-ae75e40c7660 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:35.992240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323e47-9fea-414e-a975-ae75e40c7660 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:35.994740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 743/1486] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:35.999796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148be3e-e82a-41dc-9836-c04dd55833ab None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:36.000189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148be3e-e82a-41dc-9836-c04dd55833ab None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:36.000355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148be3e-e82a-41dc-9836-c04dd55833ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:36.019022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e148be3e-e82a-41dc-9836-c04dd55833ab None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:36.020207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e148be3e-e82a-41dc-9836-c04dd55833ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:36.028027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 744/1487] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:36.065176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54323e47-9fea-414e-a975-ae75e40c7660 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:36.076251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54323e47-9fea-414e-a975-ae75e40c7660 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:36.079766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:36.080392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:36.080680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:36.080954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:36.091282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:36.091282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078cbda-5fae-4fd4-b509-025a5f88e18d service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:36.100451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 744/1488] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:38.509843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4560c2-29c2-4e90-bd6b-ea567a6aa794 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:38.510363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4560c2-29c2-4e90-bd6b-ea567a6aa794 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:38.510454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4560c2-29c2-4e90-bd6b-ea567a6aa794 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:38.512242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 745/1489] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:38.517356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd95c9-c6c1-4372-8e9d-ce8fc7e2a066 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:38.517758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd95c9-c6c1-4372-8e9d-ce8fc7e2a066 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:38.517934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd95c9-c6c1-4372-8e9d-ce8fc7e2a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:38.535674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0ebd95c9-c6c1-4372-8e9d-ce8fc7e2a066 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:38.536891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0ebd95c9-c6c1-4372-8e9d-ce8fc7e2a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:38.545166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 745/1490] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:38.584427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4560c2-29c2-4e90-bd6b-ea567a6aa794 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:38.594675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4560c2-29c2-4e90-bd6b-ea567a6aa794 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:38.598596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:38.599212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:38.599484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:38.599752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:38.609399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:38.610852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3305f9-510d-4b63-aeaa-305a7f6cb09e service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:38.620969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 746/1491] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:05:41.099323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075df00-16fc-4f2e-80f2-a53a457d11fb None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:41.099775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075df00-16fc-4f2e-80f2-a53a457d11fb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:41.099881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075df00-16fc-4f2e-80f2-a53a457d11fb None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:41.102452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 746/1492] 10.222.0.73 () {54 vars in 926 bytes} [Mon Feb 21 10:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:05:41.107601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de974-0244-4533-bfb8-0f9a28b4283b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:41.108049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de974-0244-4533-bfb8-0f9a28b4283b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:41.108165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116de974-0244-4533-bfb8-0f9a28b4283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:41.125542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-116de974-0244-4533-bfb8-0f9a28b4283b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:05:41.126725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-116de974-0244-4533-bfb8-0f9a28b4283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:05:41.134643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 747/1493] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Feb 21 10:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:05:41.173239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075df00-16fc-4f2e-80f2-a53a457d11fb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:05:41.183579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075df00-16fc-4f2e-80f2-a53a457d11fb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:05:41.187071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:05:41.187697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:05:41.187978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:05:41.188256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:05:41.196912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:05:41.198343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3a418-ce3e-46ed-b2ac-40f828cbeae9 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:05:41.207374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 747/1494] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:07:10.075391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.075965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.075965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.093571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:07:10.094760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:10.103183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 748/1495] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:07:10.111259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.111713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.111827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.130625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:07:10.131799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:10.139600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 748/1496] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:07:10.144027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.153644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df1669-f858-45f4-9655-9242ddad6a09 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.158123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.158756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.159039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.159419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.160137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:07:10.160438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.162553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.173614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 749/1497] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:07:10.181911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.190737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b321d-6d29-444e-946e-5a0926e69ea2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.195289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.195921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.196200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.196470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.197184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.199035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.242001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 749/1498] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:07:10.246403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.256228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffadbf2-c27b-4919-8ac3-759ba3ed1eb6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.309403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.310054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.310335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.310608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.311301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.313211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.332103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 750/1499] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:07:10.338707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.350361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223638ba-2505-4451-858d-e435820f41c6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.354903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.355495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.355772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.356043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.356803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.358413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.370622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 750/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:07:10.374694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.384582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a20eff-d148-42d1-bf55-dd4e84d4b55a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.389240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.389885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.390166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.390442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.391161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.392730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30433f-f956-4e67-8d37-03bab9846018 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.406359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 751/1501] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:07:10.410313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.420555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62274c63-b671-4380-a145-503e44bbcd55 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.425037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.425945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.426223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.426493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] PATH_INFO: `/v3/projects/a5ed7e360a414a07a7769b4871639aa5/users/bdb983280e4546d2a43fd91aefcc5a01/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.440375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ed7e360a414a07a7769b4871639aa5, user_id=bdb983280e4546d2a43fd91aefcc5a01, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.443004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.455886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 751/1502] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:07:10 2022] PUT /identity/v3/projects/a5ed7e360a414a07a7769b4871639aa5/users/bdb983280e4546d2a43fd91aefcc5a01/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:07:10.467585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003abf80-fd2d-40ac-9bc3-30e9714906fb None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.467871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003abf80-fd2d-40ac-9bc3-30e9714906fb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.468150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003abf80-fd2d-40ac-9bc3-30e9714906fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.494727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-003abf80-fd2d-40ac-9bc3-30e9714906fb None None] MFA Rules not processed for user `bdb983280e4546d2a43fd91aefcc5a01`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:07:10.502287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-003abf80-fd2d-40ac-9bc3-30e9714906fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:10.568252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 752/1503] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:07:10.579213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.644755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39139964-12b1-4332-86e6-ad97d57df23b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.650694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.651320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.651605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.651875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.659457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.661044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.669591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 752/1504] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:07:10.737323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b064-846e-464c-8606-a5a26b4f5717 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.737606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b064-846e-464c-8606-a5a26b4f5717 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.737898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510b064-846e-464c-8606-a5a26b4f5717 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.739618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 753/1505] 10.222.0.73 () {52 vars in 829 bytes} [Mon Feb 21 10:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:07:10.743129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:10.802009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c8a6-8191-42b1-9a44-7dcdfbeb8b7b service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:10.806446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:10.807286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.807561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.807820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] PATH_INFO: `/v3/users/bdb983280e4546d2a43fd91aefcc5a01` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.808972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb983280e4546d2a43fd91aefcc5a01)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:10.809988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 10:07:10.809988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 10:07:10.809988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 10:07:10.811157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:10.873616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb983280e4546d2a43fd91aefcc5a01'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:10.874262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb983280e4546d2a43fd91aefcc5a01'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:10.882832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb983280e4546d2a43fd91aefcc5a01'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:10.883602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb983280e4546d2a43fd91aefcc5a01'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:10.895487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb983280e4546d2a43fd91aefcc5a01'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:10.918266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 753/1506] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:07:10 2022] DELETE /identity/v3/users/bdb983280e4546d2a43fd91aefcc5a01 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:07:10.922565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:10.922854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:10.923135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:10.940522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:07:10.941720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:10.997127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 754/1507] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:07:11.007409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:11.008775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:11.063567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f6080-e69d-4902-8a95-f5c8539bdf41 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:11.067701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:11.068336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:11.068614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:11.068885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:11.077523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:11.078916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23d793-4c7a-47cd-afea-ab9e40754ebe service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:11.087846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 754/1508] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:07:11.392509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:07:11.393972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:07:11.408171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7af134-c825-48c0-b868-929966d7de61 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:07:11.413887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:07:11.414757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:07:11.415102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:07:11.415308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] PATH_INFO: `/v3/projects/a5ed7e360a414a07a7769b4871639aa5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:07:11.416572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ed7e360a414a07a7769b4871639aa5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:07:11.417639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 10:07:11.417639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 10:07:11.417639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 10:07:11.418823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:07:11.479126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ed7e360a414a07a7769b4871639aa5', 'request_id': 'req-db801ede-52d5-45ef-ae30-460361c07539'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:11.485210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ed7e360a414a07a7769b4871639aa5', 'request_id': 'req-db801ede-52d5-45ef-ae30-460361c07539'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:11.494958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ed7e360a414a07a7769b4871639aa5', 'request_id': 'req-db801ede-52d5-45ef-ae30-460361c07539'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:11.512817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] The token cache is being invalidate because project a5ed7e360a414a07a7769b4871639aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:07:11.513124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:11.513851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-db801ede-52d5-45ef-ae30-460361c07539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:07:11.515370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 755/1509] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:07:11 2022] DELETE /identity/v3/projects/a5ed7e360a414a07a7769b4871639aa5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:08:46.692036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:46.692634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:46.692634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:46.694952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 755/1510] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:08:46.699935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e7de-c898-4498-b6af-2693ac3a26af None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:46.700312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e7de-c898-4498-b6af-2693ac3a26af None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:46.700487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e7de-c898-4498-b6af-2693ac3a26af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:46.718809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-abb6e7de-c898-4498-b6af-2693ac3a26af None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:08:46.720025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-abb6e7de-c898-4498-b6af-2693ac3a26af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:08:46.776597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 756/1511] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:08:46.928069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:08:46.929754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:08:47.001028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b89c9-e048-4d3e-b7e7-406562663465 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:08:47.007162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:08:47.007794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:47.008075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:47.008350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:47.016182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:08:47.017782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463ada6-257c-4aa6-9480-aaa8698326fe service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:08:47.026999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 756/1512] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:08:48.118475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86de18-cc7c-4f79-b078-d96cef37d0ce None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:48.118954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86de18-cc7c-4f79-b078-d96cef37d0ce None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:48.119281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a86de18-cc7c-4f79-b078-d96cef37d0ce None None] PATH_INFO: `/v3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:48.121121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 757/1513] 10.222.0.45 () {54 vars in 925 bytes} [Mon Feb 21 10:08:48 2022] GET /identity/v3 => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:08:48.127777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747158e1-7365-49ec-9a6e-bc9ae01388fc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:48.128234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747158e1-7365-49ec-9a6e-bc9ae01388fc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:48.128595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747158e1-7365-49ec-9a6e-bc9ae01388fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:48.153721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-747158e1-7365-49ec-9a6e-bc9ae01388fc None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:08:48.154937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-747158e1-7365-49ec-9a6e-bc9ae01388fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:08:48.216829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 757/1514] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Feb 21 10:08:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:08:48.307923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f14b-60e4-4c2e-82e7-f436ed7b86f0 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:48.308205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f14b-60e4-4c2e-82e7-f436ed7b86f0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:48.308481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3f14b-60e4-4c2e-82e7-f436ed7b86f0 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:48.310331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 758/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:08:48.315079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5209f-9801-41f6-8ef7-a9a266b80e76 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:48.315369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5209f-9801-41f6-8ef7-a9a266b80e76 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:48.315645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5209f-9801-41f6-8ef7-a9a266b80e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:48.334768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a1b5209f-9801-41f6-8ef7-a9a266b80e76 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:08:48.335946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1b5209f-9801-41f6-8ef7-a9a266b80e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:08:48.344383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 758/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:08:48.498193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f14b-60e4-4c2e-82e7-f436ed7b86f0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:08:48.512813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3f14b-60e4-4c2e-82e7-f436ed7b86f0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:08:48.518118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:08:48.518731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:48.519007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:48.519273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:48.526976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:08:48.528540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fe0d1-1572-4ded-88a2-30703bf85ff4 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:08:48.538112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 759/1517] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:08:52.282277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d827048-7b13-4f22-80df-f244cf823dd8 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:52.282888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d827048-7b13-4f22-80df-f244cf823dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:52.282888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d827048-7b13-4f22-80df-f244cf823dd8 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:52.284595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 759/1518] 10.222.0.73 () {54 vars in 960 bytes} [Mon Feb 21 10:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:08:52.290667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7a97-6371-4ae2-8b2e-6905a5745e58 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:52.291135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7a97-6371-4ae2-8b2e-6905a5745e58 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:52.291242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b7a97-6371-4ae2-8b2e-6905a5745e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:52.308975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-888b7a97-6371-4ae2-8b2e-6905a5745e58 None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:08:52.310268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-888b7a97-6371-4ae2-8b2e-6905a5745e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:08:52.318764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 760/1519] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Feb 21 10:08:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:08:52.326368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d827048-7b13-4f22-80df-f244cf823dd8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:08:52.340664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d827048-7b13-4f22-80df-f244cf823dd8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:08:52.345927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:08:52.346562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:08:52.346877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:08:52.347154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:08:52.356271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:08:52.357869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3d6e5-8e8d-425d-8ce3-a68d11590033 service placement] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:08:52.367355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 760/1520] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:08:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:00.216895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda2eb-fc1b-48aa-a8ae-ea00f9373a2f None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:00.217496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda2eb-fc1b-48aa-a8ae-ea00f9373a2f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:00.217496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eda2eb-fc1b-48aa-a8ae-ea00f9373a2f None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:00.219275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 761/1521] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:00.224167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89100fa-e72a-4f91-8471-fed3b42904b1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:00.224615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89100fa-e72a-4f91-8471-fed3b42904b1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:00.224713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89100fa-e72a-4f91-8471-fed3b42904b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:00.242196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e89100fa-e72a-4f91-8471-fed3b42904b1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:00.243366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e89100fa-e72a-4f91-8471-fed3b42904b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:00.250890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 761/1522] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:00.400831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda2eb-fc1b-48aa-a8ae-ea00f9373a2f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:00.414633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eda2eb-fc1b-48aa-a8ae-ea00f9373a2f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:00.420185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:00.420807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:00.421119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:00.421398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:00.429801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:00.431361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396050f5-cc0d-48b2-a81c-7f00bebc8bdd service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:00.440302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 762/1523] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:01.698351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7feed-b14a-40a8-a26b-268bd74283e8 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:01.698929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7feed-b14a-40a8-a26b-268bd74283e8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:01.698929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7feed-b14a-40a8-a26b-268bd74283e8 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:01.700704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 762/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Feb 21 10:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:01.705658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc770-23b0-44db-a143-dcfaa3998f7d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:01.706126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc770-23b0-44db-a143-dcfaa3998f7d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:01.706231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cc770-23b0-44db-a143-dcfaa3998f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:01.724090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-781cc770-23b0-44db-a143-dcfaa3998f7d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:01.725286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-781cc770-23b0-44db-a143-dcfaa3998f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:01.733335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 763/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Feb 21 10:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:01.885187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7feed-b14a-40a8-a26b-268bd74283e8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:01.899697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7feed-b14a-40a8-a26b-268bd74283e8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:01.905386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:01.906027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:01.906309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:01.906586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:01.915263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:01.916813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45297410-b7eb-4636-9f0c-4fddbc0b619f service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:01.926007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 763/1526] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:06.075871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:06.076448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:06.076448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:06.078229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 764/1527] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:06.084015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e840f-36da-448c-96c7-b55bf4ba3dc6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:06.084458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e840f-36da-448c-96c7-b55bf4ba3dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:06.084563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e840f-36da-448c-96c7-b55bf4ba3dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:06.102583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a93e840f-36da-448c-96c7-b55bf4ba3dc6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:06.103765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a93e840f-36da-448c-96c7-b55bf4ba3dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:06.111527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 764/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:06.148156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:06.149875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:06.204241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa30e63-0b8b-4209-8134-ff92dade3726 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:06.208421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:06.209071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:06.209358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:06.209629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:06.218432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:06.219840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0d568-ec6e-4dee-bce1-d122c2c7ca49 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:06.228947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 765/1529] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:08.507434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc60ca-8472-40f7-b7f9-d38b6ddca3cf None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:08.507975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc60ca-8472-40f7-b7f9-d38b6ddca3cf None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:08.508108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc60ca-8472-40f7-b7f9-d38b6ddca3cf None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:08.509849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 765/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:08.515106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba805-fcf3-4490-af7f-3ae77e99fa77 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:08.515510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba805-fcf3-4490-af7f-3ae77e99fa77 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:08.515670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ba805-fcf3-4490-af7f-3ae77e99fa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:08.533401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a01ba805-fcf3-4490-af7f-3ae77e99fa77 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:08.534584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a01ba805-fcf3-4490-af7f-3ae77e99fa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:08.542933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 766/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:08.578925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc60ca-8472-40f7-b7f9-d38b6ddca3cf None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:08.590242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc60ca-8472-40f7-b7f9-d38b6ddca3cf None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:08.593783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:08.594410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:08.594697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:08.594976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:08.604411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:08.605857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55285c61-e04f-4c1e-a6e8-4e645418aece service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:08.615097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 766/1532] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:12.474755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:12.475280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:12.475280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:12.477080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 767/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:12.482436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d585f-d375-44d8-8e76-535b2787e834 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:12.482837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d585f-d375-44d8-8e76-535b2787e834 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:12.482989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d585f-d375-44d8-8e76-535b2787e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:12.500900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d75d585f-d375-44d8-8e76-535b2787e834 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:12.502350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d75d585f-d375-44d8-8e76-535b2787e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:12.510602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 767/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:12.767045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:12.768718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:12.823714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a80f7-cbb1-4146-ab9a-8aca80c33e6d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:12.827276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:12.827908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:12.828185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:12.828459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:12.837116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:12.838525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b397-c2be-4fba-a295-6eb66637b4a4 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:12.847532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 768/1535] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:09:15.204670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f818cd-6c02-4004-95ed-e7d0b776de92 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:15.205224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f818cd-6c02-4004-95ed-e7d0b776de92 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:15.205339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f818cd-6c02-4004-95ed-e7d0b776de92 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:15.207112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 768/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Feb 21 10:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:15.212190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a237d6-8711-4be3-a40c-c9c84c9d80d5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:15.212591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a237d6-8711-4be3-a40c-c9c84c9d80d5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:15.212714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a237d6-8711-4be3-a40c-c9c84c9d80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:15.231253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d6a237d6-8711-4be3-a40c-c9c84c9d80d5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:15.232444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d6a237d6-8711-4be3-a40c-c9c84c9d80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:15.240914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 769/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Feb 21 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:15.496260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ad13-7fe5-4a41-82f2-187dd92ef048 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:15.496486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ad13-7fe5-4a41-82f2-187dd92ef048 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:15.496763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4ad13-7fe5-4a41-82f2-187dd92ef048 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:15.498586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 769/1538] 10.222.0.73 () {54 vars in 963 bytes} [Mon Feb 21 10:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:09:15.503996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f7e1-ba76-4bc8-8460-102fc7837c82 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:15.504374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f7e1-ba76-4bc8-8460-102fc7837c82 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:15.504653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515f7e1-ba76-4bc8-8460-102fc7837c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:15.522897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d515f7e1-ba76-4bc8-8460-102fc7837c82 None None] MFA Rules not processed for user `731b9e74f74e4b4898bb81851831be5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:09:15.524140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d515f7e1-ba76-4bc8-8460-102fc7837c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:09:15.530545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 770/1539] 10.222.0.73 () {58 vars in 1060 bytes} [Mon Feb 21 10:09:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:09:15.538581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ad13-7fe5-4a41-82f2-187dd92ef048 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:09:15.549114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4ad13-7fe5-4a41-82f2-187dd92ef048 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:09:15.552743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:09:15.553399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:09:15.553687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:09:15.553964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:09:15.562617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:09:15.564023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5341d0-d6c1-4da7-ba8c-84c2f217086e service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:09:15.573328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 770/1540] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:40.608355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:40.611897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:40.611897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:40.633252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:40.634878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:40.649319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 771/1541] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:10:40.658632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:40.659183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:40.659183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:40.686046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:40.687366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:40.700553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 771/1542] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:40.705405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:40.717553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5860b42-a336-4823-a11c-2fc72702b59e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:40.722551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:40.723463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:40.723968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:40.724460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:40.725438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:40.725971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:40.727923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:40.744196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 772/1543] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:40.752888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:40.767044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161faf9-0c60-4d12-afcd-b8e31b9818d3 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:40.781849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:40.782538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:40.782819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:40.783094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:40.783791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:40.785755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:40.844114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 772/1544] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:40 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:40.848692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:40.864996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd842b62-b886-45c2-b040-3915cc3ee453 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:40.937798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:40.938927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:40.939434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:40.939934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:40.940923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:40.943692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:40.986755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 773/1545] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:40 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:40.992001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.007426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c9ae6-c732-46d7-894e-8c712547baeb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.016474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.017171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.017538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.017818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.018552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.020194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a603e-44b2-49cb-bbec-a85a4c9b5596 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.035153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 773/1546] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:41.039526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.052406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15771eb-5eda-44c7-841c-d0e923009346 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.057403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.058139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.058422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.058696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.059423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.062693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b999ff-3f4a-4274-9c5e-41d9085b0c2a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.062979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b999ff-3f4a-4274-9c5e-41d9085b0c2a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.063258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b999ff-3f4a-4274-9c5e-41d9085b0c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.069696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.092604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f8b999ff-3f4a-4274-9c5e-41d9085b0c2a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.093376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 774/1547] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:41.093927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f8b999ff-3f4a-4274-9c5e-41d9085b0c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.099411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.111349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 774/1548] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.119091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcb37e-8724-45f2-9523-3e94955d9ffb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.127120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ca1d-2196-4d7c-ac59-a4129826a4e7 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.127313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ca1d-2196-4d7c-ac59-a4129826a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.127677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ca1d-2196-4d7c-ac59-a4129826a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.140294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.141613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.141893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.142169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] PATH_INFO: `/v3/projects/55c503357f9d4544a24d58abe60a0d2b/users/c737f50ef7264ed983209d16e28da75b/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.170086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5898ca1d-2196-4d7c-ac59-a4129826a4e7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.171321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5898ca1d-2196-4d7c-ac59-a4129826a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.178761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c503357f9d4544a24d58abe60a0d2b, user_id=c737f50ef7264ed983209d16e28da75b, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.181798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.186951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 775/1549] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.188439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22a16-eb7c-4a90-ad8e-126c6be2247a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.188730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22a16-eb7c-4a90-ad8e-126c6be2247a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.189007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22a16-eb7c-4a90-ad8e-126c6be2247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.224848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-96e22a16-eb7c-4a90-ad8e-126c6be2247a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.226161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-96e22a16-eb7c-4a90-ad8e-126c6be2247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.226366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 775/1550] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:41 2022] PUT /identity/v3/projects/55c503357f9d4544a24d58abe60a0d2b/users/c737f50ef7264ed983209d16e28da75b/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:10:41.227261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.347775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 776/1551] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.353404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187d84-cce6-46f7-8963-7eb9e365b382 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.353657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187d84-cce6-46f7-8963-7eb9e365b382 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.353998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1187d84-cce6-46f7-8963-7eb9e365b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.354431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc5d6-ab28-4fa0-ac60-b71cd7a25109 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.367389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.368063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.368358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.368607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.369419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:41.370051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.371751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d40bf-7ce4-415f-83c7-df2d736dd192 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.385540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 776/1552] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:41.386667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a1187d84-cce6-46f7-8963-7eb9e365b382 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.386870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b030dc-0421-44f3-a35c-7e4eb719f696 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.387153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b030dc-0421-44f3-a35c-7e4eb719f696 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.387425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b030dc-0421-44f3-a35c-7e4eb719f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.387882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1187d84-cce6-46f7-8963-7eb9e365b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.400693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 777/1553] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.403086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.403379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.406266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.423074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-98b030dc-0421-44f3-a35c-7e4eb719f696 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.426163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-98b030dc-0421-44f3-a35c-7e4eb719f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.439281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.440476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.441083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 777/1554] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.442437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.442721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.442989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.457914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 778/1555] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.459206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.468355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ab0c8-a91e-43aa-b03e-2606bae24181 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.472943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.474174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.474626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.475290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.475575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.475847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.476533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.478720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ea7c1-118d-434e-af5a-209d8af8d846 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.482685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 778/1556] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.483536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.508787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 779/1557] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:41.508787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b837-bd11-4426-a6b6-0ebc4a7531d4 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.508787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b837-bd11-4426-a6b6-0ebc4a7531d4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.508787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b837-bd11-4426-a6b6-0ebc4a7531d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.525573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1a72b837-bd11-4426-a6b6-0ebc4a7531d4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.526744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1a72b837-bd11-4426-a6b6-0ebc4a7531d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.537637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652680e-387d-4f5e-be1e-50ed343148d9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.584191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.584834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.585136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.585412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.591334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 780/1558] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.598714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.598714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.598714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.598998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.598998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef77b8-a6b5-4b21-97f4-801c16e079f6 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.612288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 779/1559] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:41.614148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83963e9-72e2-492e-92e8-1d08c4807150 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.614517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83963e9-72e2-492e-92e8-1d08c4807150 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.614921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83963e9-72e2-492e-92e8-1d08c4807150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.617953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.619136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.628228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 781/1560] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.629716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.633871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a83963e9-72e2-492e-92e8-1d08c4807150 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.635268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a83963e9-72e2-492e-92e8-1d08c4807150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.639284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7d8a4-599f-4312-a6eb-003b8e84b07f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.650801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 780/1561] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.651127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.651127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.651127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.651440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.651534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.651640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.651640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.651816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:41.651816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.651816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3c694-7084-46ef-af5e-7d87c3759e7b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.668082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 782/1562] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:41.668082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d031833-07e9-42ef-99a9-5029f0091ec3 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.668082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d031833-07e9-42ef-99a9-5029f0091ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.668082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d031833-07e9-42ef-99a9-5029f0091ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.675989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.677399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.689135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 781/1563] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.689135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.695304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-3d031833-07e9-42ef-99a9-5029f0091ec3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.696549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3d031833-07e9-42ef-99a9-5029f0091ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.698616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427226-640d-4496-a994-de1fbc67abc1 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.704737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.705822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.706183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.706582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.707274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.707932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 783/1564] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.709234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58f70-8b5a-4726-956a-9e11852ccf80 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.709348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.709549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58f70-8b5a-4726-956a-9e11852ccf80 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.709780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c58f70-8b5a-4726-956a-9e11852ccf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.732277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 782/1565] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:41.732873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.735618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e4c58f70-8b5a-4726-956a-9e11852ccf80 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.736912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e4c58f70-8b5a-4726-956a-9e11852ccf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.743041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90e03a-b7e0-43fd-9e2a-94bc1880b964 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.746750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 784/1566] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.748086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aede7-4029-4f96-a92d-63bcff243c48 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.748393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.748524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aede7-4029-4f96-a92d-63bcff243c48 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.748607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150aede7-4029-4f96-a92d-63bcff243c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.749029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.749383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.749703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.750528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:41.750838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.752685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.766246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 783/1567] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:41.769942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-150aede7-4029-4f96-a92d-63bcff243c48 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.770389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.771378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-150aede7-4029-4f96-a92d-63bcff243c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.780926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 785/1568] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.782409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4d1f2-2399-4c2c-ab49-f259e06d1c0c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.785697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.785999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.786329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.787528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.789003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.789379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.789571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.790345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.792280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.805235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:41.806384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:41.823229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 786/1569] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:41.824285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.827759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 784/1570] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:41.828795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.835871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399fc3f-a715-4beb-be9b-8831243cfc85 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.894514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.894745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5cf23-8d16-4a58-9e71-bc6bc8711949 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.895239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.895771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.896119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.896997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:41.897369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.899063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.900568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.901118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.901403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.901674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.902398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.903985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.913459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 787/1571] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:41.914885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.922711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 785/1572] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:41.922711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.933574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b6fa6-eac7-4d88-b2b8-ffcad44991ee admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.934287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b760e-548a-4080-b23b-d975817a9d13 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:41.938199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.938836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.939117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.939375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.940055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.941846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:41.942076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.943239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:41.943721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:41.944194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:41.945220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:41.946011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:41.948350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:41.963298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 788/1573] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:41.967145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.974363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 786/1574] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:41.975350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:41.983919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5239e-ab4f-42fd-a5f9-790f29d98457 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.044668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.045373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.045656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.045930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.046644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:42.046950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.048599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.049761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a689d33-a5d3-474d-beea-b8e837e3e336 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.057554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.058856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.059608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.060038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.060920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:42.061406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.068666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 789/1575] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:42.068666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.070935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.077013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd98ce-7440-4312-bc61-1928df9215cf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.083974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.084505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.084722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 787/1576] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:42.085541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.092182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.092513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.093275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.095185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.103147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf6823-bb75-4b09-8b52-524684f8b221 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.108643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.109354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.109619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.109892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.110566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.112568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.124237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 790/1577] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 279 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.129929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.140115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421dfff-d04b-46ee-b7ea-3c97a5fba8d7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.143514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 788/1578] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.144378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.146289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.147595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.148134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.148835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.150383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.152919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.169463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 791/1579] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.169463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.180425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d27b1-4b7c-40e0-8d0b-b20ebf45ee97 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.208303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9959dc-5200-4df2-915a-345b61de7142 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.213923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.214579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.215159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.215159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.216030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.217735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.244044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.244713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.244999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.245306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.245983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 789/1580] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.246110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.246544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.248320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.274377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 792/1581] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.275746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.286484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bde55-cd81-4128-a21f-d689896422d5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.317869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2289b-69f5-44ad-8a7d-399f01831bcb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.324054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.325128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.325449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.325761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.326443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.328333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.357273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.358054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.358261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.358508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.359272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.361316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.368197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 790/1582] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.369427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.401389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 793/1583] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.402411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.441745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e10024-2f28-4dd9-92b2-9a4ebe293df9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.490158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4336085-b5a7-4e18-8c07-5cc037750a68 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.495439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.496328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.497453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.498032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.499068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.501746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.510149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.511131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.511226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.511446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.512368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.514571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.526156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 791/1584] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.527451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 794/1585] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.531936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.532096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.542627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbaf0-a627-491a-b43c-fcb9c28a727c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.543431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fc030-308f-4317-a867-a6b39bad027b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.547880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.548756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.549037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.549338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] PATH_INFO: `/v3/projects/96c51cf9504d4733abcb5ef8c4e8e99c/users/9d253bf911544422b553239aedaa61f5/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.549474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.550702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.551084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.551462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.553152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.555408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.567603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c51cf9504d4733abcb5ef8c4e8e99c, user_id=9d253bf911544422b553239aedaa61f5, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.570401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.585790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 795/1586] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.587285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.588018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 792/1587] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:42 2022] PUT /identity/v3/projects/96c51cf9504d4733abcb5ef8c4e8e99c/users/9d253bf911544422b553239aedaa61f5/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:42.598737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.605511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de00e6-96ca-49e5-affb-c7d86dc7bebb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.687248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edde57-625c-49f8-b24e-ca4c339665ee admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.687803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.688190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.688452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.688697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.689471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.691539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.694995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.695963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.696481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.696984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.697912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.700225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.707868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 796/1588] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.709740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.725303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3c217-2551-47d9-84b4-eee5d974dead admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.728413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 793/1589] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 303 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.729829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.733950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.734630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.734972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.735363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.736223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.739038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.743600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd002-d01f-4da2-ac5e-9118410711d6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.751391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.752540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.752885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.753213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.754232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.756524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.766976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 797/1590] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/users => generated 297 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:42.770679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 794/1591] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.770679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.771572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.781527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f198b4-0932-4877-8235-e430dcd69fea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.785504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b133d5-76bb-461d-87d0-5dcbbbd5653b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.789267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.790447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.790447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.790791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.790913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.791684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.792031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.792152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.792707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.793579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.794048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586e00-2c8f-4e90-8541-7673ffd618b0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.795324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.806345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 795/1592] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.807873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.808447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 798/1593] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.809319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.811605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.811983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.821147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65f89-fc57-42e7-9da4-377178ab500c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.827005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.827753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.828041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.828318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.829130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.830719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.841753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 799/1594] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.845480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] MFA Rules not processed for user `9d253bf911544422b553239aedaa61f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:42.845717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.849150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:42.856804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe60d88-99e7-470b-8e9c-7f6a8a2a0ec0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.862410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.863807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.864145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.864422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.865323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.866931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.880325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 800/1595] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.884344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.896142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752b8e8-9a13-47ef-a0ec-4d4fbe89c76a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.902155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.902825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.903106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.903380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.904314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.905979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.920864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 801/1596] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.920864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.928953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b928272-f3fc-4a23-8b41-bbaea1d3d51a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.933931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.935247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 796/1597] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:42.936637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.939661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.939952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.940232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] PATH_INFO: `/v3/projects/cf7c552b203f42dd8313e65dd5f04093/users/977a7348d1774e62a7317f516d08e795/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.950210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d98a3-af38-49a2-af39-378f9e423653 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:42.956286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7c552b203f42dd8313e65dd5f04093, user_id=977a7348d1774e62a7317f516d08e795, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.957935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:42.958855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:42.959237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:42.959667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.959788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:42.960652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:42.965275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:42.982837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 802/1598] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:42 2022] PUT /identity/v3/projects/cf7c552b203f42dd8313e65dd5f04093/users/977a7348d1774e62a7317f516d08e795/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:42.986788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 797/1599] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:42.986788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.987482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:42.998034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6a768-378b-4b29-9c0f-b375afa2b504 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.067242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.068851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.069470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.070315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] PATH_INFO: `/v3/projects/70c5484dd3944cfdadf5bb1f39133c62/users/ad627b8d6f5a4a88908661c838f83ae6/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.077376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215ee6a-02b8-4f3a-abd7-2dc27b51e488 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.084316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.085089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.085656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.086002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.087134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.091367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c5484dd3944cfdadf5bb1f39133c62, user_id=ad627b8d6f5a4a88908661c838f83ae6, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.094269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.098268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.107311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 803/1600] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:43.108542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.120758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17485d-ed9c-4dd7-b78d-296d76c3ad9f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.122010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 798/1601] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:42 2022] PUT /identity/v3/projects/70c5484dd3944cfdadf5bb1f39133c62/users/ad627b8d6f5a4a88908661c838f83ae6/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:43.130408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.206071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.206915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.207286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.207736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.208430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740acbb-b323-4c93-afc1-6096e1335f4e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.208651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.210378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfa4e3-8b9e-4aa7-a711-75e48eb938df admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.216286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.216952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.217252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.217531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.218251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.219846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a08af1-fb63-4fb4-83cf-0d13211bba43 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.224886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 804/1602] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:43.224886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c555b-e18a-4eb9-b4ad-5c36ff379f5c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.224886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c555b-e18a-4eb9-b4ad-5c36ff379f5c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.224886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c555b-e18a-4eb9-b4ad-5c36ff379f5c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.231150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 805/1603] 10.222.0.73 () {54 vars in 961 bytes} [Mon Feb 21 10:10:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:10:43.232131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c555b-e18a-4eb9-b4ad-5c36ff379f5c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.236148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 799/1604] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:43.238552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80c1-1411-4ebf-9994-61f19c6f7eac None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.238890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80c1-1411-4ebf-9994-61f19c6f7eac None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.239167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e80c1-1411-4ebf-9994-61f19c6f7eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.254536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c555b-e18a-4eb9-b4ad-5c36ff379f5c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.259683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.260603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.260887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.261197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] PATH_INFO: `/v3/projects/8860e437622b4f9bb4517159afb7f220/users/0ebc08c05fa84a689f6d817fa4937546/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.271864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3a9e80c1-1411-4ebf-9994-61f19c6f7eac None None] MFA Rules not processed for user `977a7348d1774e62a7317f516d08e795`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.273510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3a9e80c1-1411-4ebf-9994-61f19c6f7eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.276764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8860e437622b4f9bb4517159afb7f220, user_id=0ebc08c05fa84a689f6d817fa4937546, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.279414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.296274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 806/1605] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:43 2022] PUT /identity/v3/projects/8860e437622b4f9bb4517159afb7f220/users/0ebc08c05fa84a689f6d817fa4937546/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:43.297831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.411305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 800/1606] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.411305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c073-6b3b-469b-aaf8-791829d1229f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.411305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c073-6b3b-469b-aaf8-791829d1229f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.411305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c073-6b3b-469b-aaf8-791829d1229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.411977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13783d-21a8-4a79-8a30-e9dad628d5bc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.411977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.411977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.411977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.412458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] PATH_INFO: `/v3/projects/e7c6743e7c564ff19940036bc2529184/users/1fc7c179028a457b93a02fa6fc440051/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.421613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-5572c073-6b3b-469b-aaf8-791829d1229f None None] MFA Rules not processed for user `ad627b8d6f5a4a88908661c838f83ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.422826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5572c073-6b3b-469b-aaf8-791829d1229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.424944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c6743e7c564ff19940036bc2529184, user_id=1fc7c179028a457b93a02fa6fc440051, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.434259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.461488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 807/1607] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:43 2022] PUT /identity/v3/projects/e7c6743e7c564ff19940036bc2529184/users/1fc7c179028a457b93a02fa6fc440051/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:43.467197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.514332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 801/1608] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.515934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fded80-3f4e-4417-a1f8-60b5fa01d788 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.516817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fded80-3f4e-4417-a1f8-60b5fa01d788 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.517288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fded80-3f4e-4417-a1f8-60b5fa01d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.537769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-14fded80-3f4e-4417-a1f8-60b5fa01d788 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.539382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-14fded80-3f4e-4417-a1f8-60b5fa01d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.563441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e912d03-bfb5-4fec-bed7-ece38630ee82 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.568725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.569758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.570296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.570636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] PATH_INFO: `/v3/projects/8078e05692054283873d831ee4f3b69b/users/1d6473be0ff74756a1d9e1e4371eaa70/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.585869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8078e05692054283873d831ee4f3b69b, user_id=1d6473be0ff74756a1d9e1e4371eaa70, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.588605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.606795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 808/1609] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:43 2022] PUT /identity/v3/projects/8078e05692054283873d831ee4f3b69b/users/1d6473be0ff74756a1d9e1e4371eaa70/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:43.608106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.614682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 802/1610] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.615900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.616256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.616608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.636159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.637528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.679636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd85123-a0f7-411f-9d82-9c2adeed49c6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.684378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.685311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.685600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.685878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] PATH_INFO: `/v3/projects/cc3fac73df654ae38575bcda41bd7514/users/193d9e5225e6463ab359f019179c96fc/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.700530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3fac73df654ae38575bcda41bd7514, user_id=193d9e5225e6463ab359f019179c96fc, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.705344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dd6a6-d942-463c-b577-e3b6350d8439 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.705473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 803/1611] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.706329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.721845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 809/1612] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:43 2022] PUT /identity/v3/projects/cc3fac73df654ae38575bcda41bd7514/users/193d9e5225e6463ab359f019179c96fc/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:43.721845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43e45-b6f3-43d7-bc50-ec46a4ce1d24 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.722664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff31b9-6b19-4000-9214-26f9c1abaae2 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.722785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43e45-b6f3-43d7-bc50-ec46a4ce1d24 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.722785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43e45-b6f3-43d7-bc50-ec46a4ce1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.739664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-85e43e45-b6f3-43d7-bc50-ec46a4ce1d24 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.740879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-85e43e45-b6f3-43d7-bc50-ec46a4ce1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.782924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.783732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.784124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.785325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.785886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.787865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.806259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 810/1613] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.807699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82d9c0-d7ce-4879-9030-0341c00fc30c None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.808048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82d9c0-d7ce-4879-9030-0341c00fc30c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.808379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82d9c0-d7ce-4879-9030-0341c00fc30c None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.810883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 811/1614] 10.222.0.73 () {54 vars in 961 bytes} [Mon Feb 21 10:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:10:43.812116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.812661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.813181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.824222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 804/1615] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/projects => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:43.825906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.841514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] MFA Rules not processed for user `1d6473be0ff74756a1d9e1e4371eaa70`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:43.842734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.903967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376399-b208-4873-8c57-a4013118b777 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.911450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:43.912359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.913087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.913960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:43.918603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 812/1616] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:43.920003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:43.922637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:43.985485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:43.987446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071840d-013d-4ef0-82cb-4cd94fbd4756 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:43.997221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaace11-476e-4112-9bb0-f27c15e1cb93 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:43.998086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 805/1617] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:43.999383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:43.999923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:43.999923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.004932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.005633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.005920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.006458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.027972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:44.029528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:44.089117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.092570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947488-f3ae-44f2-a83d-39177cbf8c9b service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.106033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 813/1618] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:44.107635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.108030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.108397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.135852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:44.138385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:44.154760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 806/1619] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:44.154760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.161685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 814/1620] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Feb 21 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:44.162873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.173373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b8bc5-6189-4ad4-b405-bb07f0692fa4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.176580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccf7c3-6644-492f-b992-e0444c79a35d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.181480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.182133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.182412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.182688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.182958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.183930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.184365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.184842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.185931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.188106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.205445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.208079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.222743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 815/1621] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:44 2022] POST /identity/v3/users => generated 285 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:44.226927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.233392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 807/1622] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:44.233392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.245814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba3019-3111-4669-b404-2afd3907f648 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.252411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.254105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.254653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.255291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.256401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.256724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183c6b9-3f21-4616-9256-234e6bb2a5f5 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.259163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.271366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.272027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.272305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.272578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.318219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 816/1623] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:44 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:44.318954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.410213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.411826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.427897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 808/1624] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:44.429080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.444311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b749eb0-7566-41e4-98b6-17c63306a9be service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.455334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e31861-c24e-416f-802d-377efa0146ce admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.469493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.470169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.470453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.470746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.549636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.551443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.551967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.552332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.553561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.555911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.576287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 809/1625] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:44.577367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.589532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717acc7e-d76f-45d1-a1d4-c050a46f98a8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.596216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.599599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.600037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.600413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.601451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.603495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad898c20-f5d4-4ec8-a015-fbb5f2d3316f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.642010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 810/1626] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:44 2022] POST /identity/v3/users => generated 309 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:44.643907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac317b9-396c-4430-82d1-af867bc32e5b None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.647137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac317b9-396c-4430-82d1-af867bc32e5b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.648439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac317b9-396c-4430-82d1-af867bc32e5b None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.654151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 811/1627] 10.222.0.73 () {54 vars in 912 bytes} [Mon Feb 21 10:10:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:10:44.656669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac317b9-396c-4430-82d1-af867bc32e5b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.661032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.662515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.679036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 817/1628] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:44.679908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.686345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac317b9-396c-4430-82d1-af867bc32e5b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.694694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.695868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.696292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.696661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] PATH_INFO: `/v3/projects/70f393c409b04bb18fc1b30783d53567/users/4bec1fa02f954b9a8c526edd1a449796/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.718279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f393c409b04bb18fc1b30783d53567, user_id=4bec1fa02f954b9a8c526edd1a449796, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.723461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c9ef3-0374-4bf3-aaa8-0ee604609672 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.723917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc48e43-4b5c-4a28-8cb0-6bc5be4d3eb3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.735402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.736133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.736396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.736672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.737429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.739728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.746264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 812/1629] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:44 2022] PUT /identity/v3/projects/70f393c409b04bb18fc1b30783d53567/users/4bec1fa02f954b9a8c526edd1a449796/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:44.747811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.748931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.749394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.762708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 818/1630] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:44.763558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.777370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:44.780650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:44.797885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadab0-7d52-43ff-b6fc-e0426450c8af admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:44.900353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 813/1631] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:10:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:44.901465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:44.962384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:44.963373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:44.963799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:44.966573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:44.967497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:44.969308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:44.994134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8111f4-5d97-4def-be29-7b84ea2f55ad None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.006950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 819/1632] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:45.008030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:45.016996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.018038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.018415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.018784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] PATH_INFO: `/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71/users/fb73f83a02794d1d8cb7e43edb05f601/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.041187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67535b4c37f4860acdfb0c8e53fbc71, user_id=fb73f83a02794d1d8cb7e43edb05f601, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:45.044715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:45.076654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 814/1633] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:44 2022] PUT /identity/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71/users/fb73f83a02794d1d8cb7e43edb05f601/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:45.077531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:45.161999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c8d5e-b7d0-4b17-872b-9edeb9a3583d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.195285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c24cf-0172-4252-8ec7-255105d86b75 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.201809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.205013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.205617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.205898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] PATH_INFO: `/v3/projects/70f393c409b04bb18fc1b30783d53567/users/4bec1fa02f954b9a8c526edd1a449796/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.209208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f393c409b04bb18fc1b30783d53567, user_id=4bec1fa02f954b9a8c526edd1a449796, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:45.213663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:45.242832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 815/1634] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:45 2022] PUT /identity/v3/projects/70f393c409b04bb18fc1b30783d53567/users/4bec1fa02f954b9a8c526edd1a449796/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:45.244447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:45.270196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.271155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.271155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.271361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.380183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9054c-c281-4dc1-b97a-d6dbadcf37bb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.399510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.400670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.401539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.402214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.404169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:45.408393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda68cb7-a928-4873-bad0-e4dcf212057b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:45.435793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:45.437522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:45.442184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 816/1635] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:45.447976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e17-194f-4c31-bd43-f8d31a0319da None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.449882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e17-194f-4c31-bd43-f8d31a0319da None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.450907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b5e17-194f-4c31-bd43-f8d31a0319da None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.457283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 817/1636] 10.222.0.73 () {54 vars in 912 bytes} [Mon Feb 21 10:10:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:10:45.461742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39631257-0a81-472f-ac27-9aaa19cf9d3c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.463676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39631257-0a81-472f-ac27-9aaa19cf9d3c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.464072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39631257-0a81-472f-ac27-9aaa19cf9d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.481563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 820/1637] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:45.482551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:45.524510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89d13-cec3-445e-b631-0d9d80d0a9b6 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.537785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.538698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.538978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.539257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] PATH_INFO: `/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71/users/fb73f83a02794d1d8cb7e43edb05f601/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.542345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67535b4c37f4860acdfb0c8e53fbc71, user_id=fb73f83a02794d1d8cb7e43edb05f601, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:45.545107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-39631257-0a81-472f-ac27-9aaa19cf9d3c None None] MFA Rules not processed for user `4bec1fa02f954b9a8c526edd1a449796`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:45.546655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-39631257-0a81-472f-ac27-9aaa19cf9d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:45.546921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d394e74-d018-47b6-b07e-5f810af9cf2e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:45.600221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 821/1638] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:45 2022] PUT /identity/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71/users/fb73f83a02794d1d8cb7e43edb05f601/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:45.600221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.600221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.600221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.633810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:45.635358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:45.729270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 818/1639] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:45.733665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.734763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.735241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.797677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 822/1640] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:45.798661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:45.801912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] MFA Rules not processed for user `fb73f83a02794d1d8cb7e43edb05f601`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:45.805607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:45.935065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8b398-1bf5-406f-be92-307ecee6da81 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:45.943794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:45.944929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:45.947093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:45.947457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:45.974280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 819/1641] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:46.061226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:46.062908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:46.085957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 823/1642] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:45 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:46.204618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:46.214896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98287e-cfb1-4b09-993e-62d4782dbacc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:46.230114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:46.230802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:46.231087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:46.231364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:46.257103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:46.258683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:46.297795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 820/1643] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:46.447593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:46.459295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909da38f-0412-4446-b7b9-c502fc7ad234 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:46.463182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:46.463831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:46.464179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:46.464461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:46.487373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:46.489549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:46.502538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 824/1644] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:46.741787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:46.753164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e9990-57dc-4bb2-a357-a793c2dab870 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:46.761173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:46.762011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:46.762459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:46.762897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:46.898241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:46.899702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:46.937536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 821/1645] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:46 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:47.140779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:47.352759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefe353-1d45-42e4-bfa5-94eb848ca55a service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:47.358337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:47.369521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:47.370868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.371324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.371768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] PATH_INFO: `/v3/users/ad627b8d6f5a4a88908661c838f83ae6` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.373386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad627b8d6f5a4a88908661c838f83ae6)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:47.380412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c504b66-0a81-4b13-8f0f-24e069d82a06 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:47.382192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:47.396837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:47.398626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.399416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.400756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] PATH_INFO: `/v3/users/1d6473be0ff74756a1d9e1e4371eaa70` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.404309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6473be0ff74756a1d9e1e4371eaa70)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:47.407226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: WARNING py.warnings [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 10:10:47.407226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: warnings.warn(msg) Feb 21 10:10:47.407226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: Feb 21 10:10:47.408702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:47.498190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad627b8d6f5a4a88908661c838f83ae6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.499964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad627b8d6f5a4a88908661c838f83ae6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.520045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad627b8d6f5a4a88908661c838f83ae6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.522428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad627b8d6f5a4a88908661c838f83ae6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.540065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67c9279e-9bcb-4277-af98-33313d85cfed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad627b8d6f5a4a88908661c838f83ae6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.546412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6473be0ff74756a1d9e1e4371eaa70'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.548941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6473be0ff74756a1d9e1e4371eaa70'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.578303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 825/1646] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:10:47 2022] DELETE /identity/v3/users/ad627b8d6f5a4a88908661c838f83ae6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:47.585652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b46bd-d9ef-4194-83cd-8f099dce77ac None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.586324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b46bd-d9ef-4194-83cd-8f099dce77ac None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.587055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b46bd-d9ef-4194-83cd-8f099dce77ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.597414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6473be0ff74756a1d9e1e4371eaa70'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.630173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6473be0ff74756a1d9e1e4371eaa70'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.630798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f6633f3f-b57d-4eb0-95a6-eb41f721b46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6473be0ff74756a1d9e1e4371eaa70'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:47.658088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 822/1647] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:10:47 2022] DELETE /identity/v3/users/1d6473be0ff74756a1d9e1e4371eaa70 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:47.659514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aec9f-8a9c-488f-ae69-bbe0c0168228 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.659808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aec9f-8a9c-488f-ae69-bbe0c0168228 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.660082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aec9f-8a9c-488f-ae69-bbe0c0168228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.666346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f27b46bd-d9ef-4194-83cd-8f099dce77ac None None] MFA Rules not processed for user `0ebc08c05fa84a689f6d817fa4937546`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:47.668047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f27b46bd-d9ef-4194-83cd-8f099dce77ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:47.686105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7c9aec9f-8a9c-488f-ae69-bbe0c0168228 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:47.687324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7c9aec9f-8a9c-488f-ae69-bbe0c0168228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:47.777919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 826/1648] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:47.780892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.781370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.781859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.813342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:47.814748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:47.845302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 823/1649] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:47.850527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:47.851182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:47.852438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:47.895569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] MFA Rules not processed for user `0ebc08c05fa84a689f6d817fa4937546`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:47.897850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:47.918275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 824/1650] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:47.919227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:47.922583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:47.968835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 827/1651] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:47.973345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:47.979796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:48.062206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b9c2-d5db-4986-8b61-32a3546e29db None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:48.074796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:48.078623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:48.079130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:48.079412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:48.119372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:48.132862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:48.134907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b655f-2f14-4e9a-979c-32a849fbb066 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:48.144409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:48.144890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:48.145114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:48.145578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:48.163687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 825/1652] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:48.164706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:48.177625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:48.182448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9274a-9299-4432-8add-ca10e1febf01 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:48.182603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcef8b-259f-4bbc-9926-8e78cfbc7f85 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:48.198059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:48.199546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:48.199929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:48.200206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:48.209558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 828/1653] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:48.220913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:48.225827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b9386-5efe-4ed3-aed2-18c54db4be0b service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:48.250374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 826/1654] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:49.193627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.194503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.194986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.304100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] MFA Rules not processed for user `c737f50ef7264ed983209d16e28da75b`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:49.312424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.402624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9095-757b-4df5-b568-c9a8a8f51099 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.403604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9095-757b-4df5-b568-c9a8a8f51099 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.404079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c9095-757b-4df5-b568-c9a8a8f51099 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.407479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 827/1655] 10.222.0.73 () {54 vars in 912 bytes} [Mon Feb 21 10:10:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 10:10:49.418069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.418800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.419085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.432682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 829/1656] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:49.444633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:49.446400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.484348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b31b9-5b7e-4866-a986-a7ae9513d350 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:49.504257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:49.505688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.505987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.506264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.516244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:49.517475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.527111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:49.530708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:49.533112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 828/1657] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:10:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:49.554520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 830/1658] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:10:49.580308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:49.581998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.599046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf08b7-559e-4356-913e-ff9abb65e12e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:49.606060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:49.607057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.608261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.609257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.627089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:49.629026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:49.639479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 829/1659] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:49.800732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:49.801925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.823482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5069f24-09dd-4878-8114-d6d18cdf1b6a service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:49.830173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:49.832138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.833097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.834176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] PATH_INFO: `/v3/projects/70c5484dd3944cfdadf5bb1f39133c62` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.837399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c5484dd3944cfdadf5bb1f39133c62)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:49.839283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: WARNING py.warnings [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 21 10:10:49.839283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: warnings.warn(msg) Feb 21 10:10:49.839283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: Feb 21 10:10:49.841516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:49.848740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:49.851067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:49.875394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8aa87-8dd3-4758-bc08-c1ce72bd5302 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:49.890511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:49.891964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:49.892263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:49.892525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] PATH_INFO: `/v3/projects/8078e05692054283873d831ee4f3b69b` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:49.894314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8078e05692054283873d831ee4f3b69b)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:49.896738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.002517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8078e05692054283873d831ee4f3b69b', 'request_id': 'req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.005729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c5484dd3944cfdadf5bb1f39133c62', 'request_id': 'req-5d684f68-fc07-4264-b9c5-65ba2441c5bb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.014254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8078e05692054283873d831ee4f3b69b', 'request_id': 'req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.027308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c5484dd3944cfdadf5bb1f39133c62', 'request_id': 'req-5d684f68-fc07-4264-b9c5-65ba2441c5bb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.037376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8078e05692054283873d831ee4f3b69b', 'request_id': 'req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.051346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] The token cache is being invalidate because project 8078e05692054283873d831ee4f3b69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:10:50.051346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.052286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.053941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c5484dd3944cfdadf5bb1f39133c62', 'request_id': 'req-5d684f68-fc07-4264-b9c5-65ba2441c5bb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.055281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 830/1660] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:10:49 2022] DELETE /identity/v3/projects/8078e05692054283873d831ee4f3b69b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:50.058527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.060835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:50.097853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] The token cache is being invalidate because project 70c5484dd3944cfdadf5bb1f39133c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:10:50.098149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.101628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5d684f68-fc07-4264-b9c5-65ba2441c5bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.106523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 831/1661] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:10:49 2022] DELETE /identity/v3/projects/70c5484dd3944cfdadf5bb1f39133c62 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:50.113420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f169-9316-4f33-914a-b7a20e5ea114 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.113709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f169-9316-4f33-914a-b7a20e5ea114 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.113992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f169-9316-4f33-914a-b7a20e5ea114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.170486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8afe6-b3c1-4a6f-a98e-e5afead24451 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.183934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fcd8f169-9316-4f33-914a-b7a20e5ea114 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:50.184265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:50.185316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.185604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.185881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] PATH_INFO: `/v3/users/fb73f83a02794d1d8cb7e43edb05f601` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.187232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb73f83a02794d1d8cb7e43edb05f601)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:50.189100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fcd8f169-9316-4f33-914a-b7a20e5ea114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:50.190373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.223004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 832/1662] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:10:50.228392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.228698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.228975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.290216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb73f83a02794d1d8cb7e43edb05f601'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.291264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb73f83a02794d1d8cb7e43edb05f601'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.298151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:50.299373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:50.317121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 833/1663] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:50.320925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.334094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb73f83a02794d1d8cb7e43edb05f601'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.336313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44765ef3-1467-44bf-a722-fae4095fbddc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.355510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:50.356398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.356863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.357322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.358262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:50.358740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:50.360508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.364903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb73f83a02794d1d8cb7e43edb05f601'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.365692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb73f83a02794d1d8cb7e43edb05f601'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.400634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 831/1664] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:10:50 2022] DELETE /identity/v3/users/fb73f83a02794d1d8cb7e43edb05f601 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:50.410582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 834/1665] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:10:50.414963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.596183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.600321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:50.602352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee574ed-750a-4a30-853b-b826e2df1b98 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.611303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:50.611751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.612402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.612835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.613951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:50.616506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.636698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0c1f-507d-49c3-9b58-66757fbe4198 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.669570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:50.672100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.674000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.674475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] PATH_INFO: `/v3/users/9d253bf911544422b553239aedaa61f5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.679192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 832/1666] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:50 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:50.680490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d253bf911544422b553239aedaa61f5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:50.682777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.690090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.757938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302dea-16d7-4e84-a2d8-7c8fbc098c21 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.770957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:50.771707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.771999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.772294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.773983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:50.786727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c80cef-c69a-416e-9230-1f983d4ccd1f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:50.819741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d253bf911544422b553239aedaa61f5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.821485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d253bf911544422b553239aedaa61f5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.846029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 833/1667] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:50 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:50.848257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.850219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d253bf911544422b553239aedaa61f5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.851279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d253bf911544422b553239aedaa61f5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.856541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.858777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:50.869828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e304a8fd-c995-46d8-82ad-893507aa397e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d253bf911544422b553239aedaa61f5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:50.873757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 834/1668] 10.222.0.73 () {54 vars in 960 bytes} [Mon Feb 21 10:10:50 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:10:50.879081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:50.886661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:50.947839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 835/1669] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:10:50 2022] DELETE /identity/v3/users/9d253bf911544422b553239aedaa61f5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:50.950324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6dec-3835-4930-a41f-a9947e307b4a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:50.953259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:50.953554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:50.953831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.026367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] MFA Rules not processed for user `7275cff197074a10a2aad87fc5343248`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:51.030067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:51.146911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.149977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.150837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.150837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.152809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.158437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e22306-daa3-4d54-bcda-c9d92bb4affd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.189043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 835/1670] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:51.191692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.192240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.192684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.211784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 836/1671] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Feb 21 10:10:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:51.212943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.225467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c13b6-8601-422b-9bcf-b7ff16851458 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.232674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.234183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.234640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.235519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.236045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:51.236661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.237354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:51.238920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.259598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 836/1673] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:51.260821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.261260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 837/1673] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:51.262353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.279620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb513f-3334-4394-ae77-7c3788e54bb3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.287322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.289202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.289757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.290520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] PATH_INFO: `/v3/projects/425aa79ed70a453eb53f71930c0411c6/users/74c38843421e4d7484935d65af8a8c5f/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.305836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ebc77-271c-4a05-b537-1052a2976097 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.334858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.335024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=425aa79ed70a453eb53f71930c0411c6, user_id=74c38843421e4d7484935d65af8a8c5f, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.336584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.337572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.338001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.339214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.343603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:51.375764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.379400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276a419-ed67-46fb-95c9-7d2baf9709c1 service placement] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.401347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 838/1674] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:51 2022] PUT /identity/v3/projects/425aa79ed70a453eb53f71930c0411c6/users/74c38843421e4d7484935d65af8a8c5f/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:51.406163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.414345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:51.415526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 837/1675] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:51.423870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.424229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.424400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.499183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] MFA Rules not processed for user `74c38843421e4d7484935d65af8a8c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:51.502620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:51.541402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1674b4-c9f8-4480-94eb-5e5c97e206e3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.557779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.558452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.558734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.559010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.651804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.653851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.680911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 839/1676] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:51.698644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 838/1677] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:51.703402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.725624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd89477-3c75-4ee6-8fc5-b163fe030fb5 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.738447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.739135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.739420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.739713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.740397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.742342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:51.813440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 840/1678] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:51 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:51.815741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:51.835626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf639b-9731-4b37-ab76-7da79c9afae3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:51.978743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:51.979579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:51.979967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:51.980346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:51.981166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:51.983208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.032153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 839/1679] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:51 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:52.036855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.052858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33611492-66a3-4b01-a75a-e08600ffcbee admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.068594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.071174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.071694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.072071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.073352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.076279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.096090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 841/1680] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:52.101554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.116203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd249a-5ff9-4e76-b590-bb2890dad524 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.132400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.133270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.133747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.134292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] PATH_INFO: `/v3/projects/7b7d8341a1704825b6d9d7864320414b/users/e855063d5e4f45fb8784c3c5c1aecf19/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.187293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7d8341a1704825b6d9d7864320414b, user_id=e855063d5e4f45fb8784c3c5c1aecf19, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.191063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.216707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 840/1681] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:52 2022] PUT /identity/v3/projects/7b7d8341a1704825b6d9d7864320414b/users/e855063d5e4f45fb8784c3c5c1aecf19/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:52.220729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.234492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa56f1-cabb-4b81-b640-2f10b6063278 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.373867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.374646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.374999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.375499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.376940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.379638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714861-b5d1-4d41-9be3-1b2350a03858 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.404498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 842/1682] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:52.408427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.423361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608514e7-0db8-461e-a65c-46631bef63ff admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.436446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.437556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.437844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.438107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] PATH_INFO: `/v3/projects/7b7d8341a1704825b6d9d7864320414b/users/e855063d5e4f45fb8784c3c5c1aecf19/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.441679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7d8341a1704825b6d9d7864320414b, user_id=e855063d5e4f45fb8784c3c5c1aecf19, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.449398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.469624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 841/1683] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:52 2022] PUT /identity/v3/projects/7b7d8341a1704825b6d9d7864320414b/users/e855063d5e4f45fb8784c3c5c1aecf19/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:52.480225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.480523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.480803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.489445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.493657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:52.563840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] MFA Rules not processed for user `e855063d5e4f45fb8784c3c5c1aecf19`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:52.564990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:52.698807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0909b98-bca8-4409-a315-54e25fb8807a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.706925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.708303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.708765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.709356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] PATH_INFO: `/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.711145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67535b4c37f4860acdfb0c8e53fbc71)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.714091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.795913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 843/1684] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:52.795913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.795913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:52.821814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b76dfd-de74-4089-89f0-70aed70fac25 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:52.832271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:52.836057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:52.836343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:52.836623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] PATH_INFO: `/v3/projects/96c51cf9504d4733abcb5ef8c4e8e99c` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:52.838769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c51cf9504d4733abcb5ef8c4e8e99c)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:52.840691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:52.890931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67535b4c37f4860acdfb0c8e53fbc71', 'request_id': 'req-29a253b7-613a-411a-b956-742fb06eab32'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.924354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67535b4c37f4860acdfb0c8e53fbc71', 'request_id': 'req-29a253b7-613a-411a-b956-742fb06eab32'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.960267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c51cf9504d4733abcb5ef8c4e8e99c', 'request_id': 'req-d601d0f7-3577-4042-b008-5c4f3dd8bb03'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.962202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67535b4c37f4860acdfb0c8e53fbc71', 'request_id': 'req-29a253b7-613a-411a-b956-742fb06eab32'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.983013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] The token cache is being invalidate because project f67535b4c37f4860acdfb0c8e53fbc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:10:52.984720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c51cf9504d4733abcb5ef8c4e8e99c', 'request_id': 'req-d601d0f7-3577-4042-b008-5c4f3dd8bb03'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.984834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.985722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.993948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 842/1685] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:10:52 2022] DELETE /identity/v3/projects/f67535b4c37f4860acdfb0c8e53fbc71 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:52.996173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:52.996732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c51cf9504d4733abcb5ef8c4e8e99c', 'request_id': 'req-d601d0f7-3577-4042-b008-5c4f3dd8bb03'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:52.998184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.018815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] The token cache is being invalidate because project 96c51cf9504d4733abcb5ef8c4e8e99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:10:53.019106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:53.021045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d601d0f7-3577-4042-b008-5c4f3dd8bb03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:10:53.027357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 844/1686] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:10:52 2022] DELETE /identity/v3/projects/96c51cf9504d4733abcb5ef8c4e8e99c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:53.028800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0487a0-16a6-4809-984a-31397052c801 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.029121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0487a0-16a6-4809-984a-31397052c801 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.029406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0487a0-16a6-4809-984a-31397052c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.075963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1a0487a0-16a6-4809-984a-31397052c801 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:53.077218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1a0487a0-16a6-4809-984a-31397052c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.162153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a253b7-613a-411a-b956-742fb06eab32 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.193221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 845/1687] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:53.194994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405b37-cfdc-4fdc-b318-ff3b3aa8bb86 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.195152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405b37-cfdc-4fdc-b318-ff3b3aa8bb86 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.195444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed405b37-cfdc-4fdc-b318-ff3b3aa8bb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.253213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ed405b37-cfdc-4fdc-b318-ff3b3aa8bb86 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:53.255356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ed405b37-cfdc-4fdc-b318-ff3b3aa8bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.297425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 846/1688] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:53.302895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee1b2-1867-4f58-929e-b5f1539b9244 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.303587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee1b2-1867-4f58-929e-b5f1539b9244 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.304193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ee1b2-1867-4f58-929e-b5f1539b9244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.305467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.306938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.306938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.306938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.308769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.352706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6d9ee1b2-1867-4f58-929e-b5f1539b9244 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:53.356577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6d9ee1b2-1867-4f58-929e-b5f1539b9244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.381480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 847/1689] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:53.384135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.384800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.385359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.435582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:53.438520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.439774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.441415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:53.462304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 848/1690] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:53.463637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.468839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 843/1691] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:53.469761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.484196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb669-b434-4506-8dd2-ff07d85e04ed None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.497087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c1fc7-4073-42f6-9f49-8d5cb4f26814 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.500062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.502021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.502536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.503120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.504451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:53.504978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.510626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:53.511452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.512150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.512428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.512700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.513452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:10:53.513753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.515338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:53.536999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 844/1692] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:53.540933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 849/1693] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:10:53.542165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.544693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.561967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e4003-6112-4443-89e8-5d074c31d994 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.567109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86eef7-7b5e-465c-9920-ba574d350520 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.579417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.580704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.581800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.582257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.583210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.585316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:53.599456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.600290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.602024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.602422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.604176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.608315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:53.661401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 845/1694] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:10:53.665710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.698009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 850/1695] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:10:53.699270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:53.703258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.853332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76453a6-0594-49b8-ae13-239f6453122b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.854506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835db256-52da-4dac-b38c-700d9e10f9c1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:53.860611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.862575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.875254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.876517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.883750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:53.973524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:53.974362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:53.974758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:53.975130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:53.975922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:53.977961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.024094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 846/1696] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:53 2022] POST /identity/v3/users => generated 284 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:54.025066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.050271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faaf3a-9f90-4b8c-a2f2-6147b16c1604 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.062613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.063386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.063683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.063808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.064109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.065148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.068306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.072732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.097429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 851/1697] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:54.109484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.128754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 847/1698] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:10:54 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:10:54.134418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.140224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62a9da-280b-40b8-945b-588cd3baeeb6 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.146587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.147406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.147693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.147969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.149812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.161034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.161267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d34d7-c39b-4a14-990e-0cd52d269578 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.178048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 852/1699] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:54.179228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.182683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.184276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.186200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.186594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.187453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.192298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.192964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d168d-e8ee-430e-9bee-7ed6af834f98 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.198968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.200638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.200937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.201452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.202221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.204631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.227839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 848/1701] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:54.228996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.229148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 853/1701] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:54.230343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.248891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b5f7-8224-4b04-9fba-a2223d81db15 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.258577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.259559 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.259942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.260943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.262362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.265221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.281441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb2b1f-f789-481c-b510-53af359552d8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.293193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 854/1702] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:10:54.294921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.295938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.296139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.297105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.297468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] PATH_INFO: `/v3/projects/c8fcf33e45c749a4ada612b80f852b66/users/8d0f95158ea04255a0bf6ca81852352a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.314038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b85bb-7c68-4f11-ab22-c1bf79e4adee admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.329998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fcf33e45c749a4ada612b80f852b66, user_id=8d0f95158ea04255a0bf6ca81852352a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.337903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afc669-de38-4d18-b43d-b21d7b603908 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.360379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.371659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 849/1703] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:54 2022] PUT /identity/v3/projects/c8fcf33e45c749a4ada612b80f852b66/users/8d0f95158ea04255a0bf6ca81852352a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:54.371971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.371971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.371971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] PATH_INFO: `/v3/projects/6931a0f13ec746e8b51043634130c72a/users/d19d597749b04d04ab414abdf179d9cd/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.375033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.375396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.375830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.410680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6931a0f13ec746e8b51043634130c72a, user_id=d19d597749b04d04ab414abdf179d9cd, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.414970 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375434a-7e5b-4451-8d20-ddf8501226b1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.438208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] MFA Rules not processed for user `8d0f95158ea04255a0bf6ca81852352a`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:54.449267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 855/1704] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:10:54 2022] PUT /identity/v3/projects/6931a0f13ec746e8b51043634130c72a/users/d19d597749b04d04ab414abdf179d9cd/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:10:54.450414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:54.450981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.451334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.451909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.494956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:54.496277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:54.555787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 850/1705] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:54.561355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.638467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 856/1706] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:54.647025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d01ff-b8db-4795-9a8a-113cdcce9832 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.652044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.652742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.653027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.653414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:54.664239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:54.665832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82192f1c-d5a8-4349-8477-2e0cbe8a62d9 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:54.677478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 851/1707] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:54.796673 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:54.801389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:54.969549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fea2f3-2154-46a2-a6e1-c2db05bfa66a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:54.983188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:54.983856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:54.984434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:54.984434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:55.002624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:55.004043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:55.028492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 857/1708] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:10:55.279950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815482-a29b-46a1-9e92-490243c960fa None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:55.279950 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815482-a29b-46a1-9e92-490243c960fa None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:55.280220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0815482-a29b-46a1-9e92-490243c960fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:55.337174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f0815482-a29b-46a1-9e92-490243c960fa None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:55.338763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f0815482-a29b-46a1-9e92-490243c960fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:55.521479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 852/1709] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:10:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:55.927195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:10:55.928949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:56.293796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8d740-222f-4931-92b8-bb82b1de75f2 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:10:56.322429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:10:56.323113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:56.323401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:56.323680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:56.364686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:10:56.366361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb20a2-4b4f-41de-94d1-63b968457f36 service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:10:56.402819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 858/1710] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:10:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:10:58.663241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26f79-9f25-4a8e-896e-daf76d961adc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:58.663733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26f79-9f25-4a8e-896e-daf76d961adc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:58.663892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c26f79-9f25-4a8e-896e-daf76d961adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:10:58.767419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-74c26f79-9f25-4a8e-896e-daf76d961adc None None] MFA Rules not processed for user `c737f50ef7264ed983209d16e28da75b`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:10:58.771561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-74c26f79-9f25-4a8e-896e-daf76d961adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:10:58.915447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 853/1711] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:10:59.993442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:10:59.994593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:10:59.995128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.069506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] MFA Rules not processed for user `d19d597749b04d04ab414abdf179d9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:00.073635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:00.113726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.114730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.115225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.214608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] MFA Rules not processed for user `1fc7c179028a457b93a02fa6fc440051`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:00.220776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:00.393500 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 859/1712] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:10:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:00.396142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.456493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5bcb-4259-4e25-811b-422eca93a770 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:00.477886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:00.478583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.478867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.485355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.485477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 854/1713] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:00.488701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:00.490727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3917548-946e-4ffd-be65-d59d845e98f3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:00.584707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 860/1714] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:00 2022] POST /identity/v3/projects => generated 403 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:00.587907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.610527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ac43b-fd4f-4f19-a4e5-39437359f379 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:00.622832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7462cf-cd28-490a-9ffb-acdfb23b182f None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.623110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7462cf-cd28-490a-9ffb-acdfb23b182f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.623604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7462cf-cd28-490a-9ffb-acdfb23b182f None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.626903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 861/1715] 10.222.0.73 () {54 vars in 912 bytes} [Mon Feb 21 10:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 21 10:11:00.633025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.633749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.634208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.680934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:00.684345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:00.758840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:00.759654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.759957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.760303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.761163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:00.764772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:00.813362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 855/1716] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:00 2022] POST /identity/v3/users => generated 308 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:00.814761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.834416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbe077a-3a3a-46c8-8c90-9e7971819c1a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:00.835947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 862/1717] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:11:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:00.850195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:00.851149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.851589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.852012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.853021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:00.854081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.854990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:00.884537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 856/1718] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:00.885353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c6d9a-f61c-4d3a-b9dc-5dbd9c5af6ab None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:00.885479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.895327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:00.899244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.899775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.901130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.902998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd298-7cb0-43da-bd55-ad49baff10d9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:00.917297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:00.917734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:00.918647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:00.918924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:00.919196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] PATH_INFO: `/v3/projects/a0420ba2f5724a57ab833541efbd6004/users/e000f3bac6a146238223d525f5717b63/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:00.919577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:00.947015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 863/1719] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:00.948940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:00.951218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:00.985345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0420ba2f5724a57ab833541efbd6004, user_id=e000f3bac6a146238223d525f5717b63, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:00.990033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:01.027335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 857/1720] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:00 2022] PUT /identity/v3/projects/a0420ba2f5724a57ab833541efbd6004/users/e000f3bac6a146238223d525f5717b63/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:01.028621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:01.126315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e068e60-8a96-48a4-a977-e8cf757ef577 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:01.229477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde013c1-78f3-475d-935c-7d247d04801d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:01.247321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:01.248417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:01.248718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:01.248991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:01.264943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:01.266996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:01.292248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 858/1721] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:01 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:01.298787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:01.338703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d9930-872c-459d-b39e-49dd10997742 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:01.360506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:01.361823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:01.363967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:01.364535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:01.364812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] PATH_INFO: `/v3/projects/a0420ba2f5724a57ab833541efbd6004/users/e000f3bac6a146238223d525f5717b63/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:01.365451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:01.367198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:01.367493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:01.379489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0420ba2f5724a57ab833541efbd6004, user_id=e000f3bac6a146238223d525f5717b63, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:01.384964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d251992-6536-4bba-97f7-ae8c32f225c5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:01.442094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 859/1722] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:01 2022] PUT /identity/v3/projects/a0420ba2f5724a57ab833541efbd6004/users/e000f3bac6a146238223d525f5717b63/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:01.443530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:01.443828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:01.444109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:01.503894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:01.505510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead864a-abb9-4e8b-a03f-afcca1ffd0f7 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:01.525483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 864/1723] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:01.548784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] MFA Rules not processed for user `193d9e5225e6463ab359f019179c96fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:01.551113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:01.728355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ef62-1e05-4d92-94f0-50bb71d6fe9e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:01.728544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 860/1724] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:01.729039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ef62-1e05-4d92-94f0-50bb71d6fe9e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:01.729519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7ef62-1e05-4d92-94f0-50bb71d6fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:01.779852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f8c7ef62-1e05-4d92-94f0-50bb71d6fe9e None None] MFA Rules not processed for user `193d9e5225e6463ab359f019179c96fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:01.782173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f8c7ef62-1e05-4d92-94f0-50bb71d6fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:01.821065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 865/1725] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:01.831934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:01.833412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:02.015742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294a64b-5ea7-4469-9fe4-2f9c9525b81d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:02.047115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:02.047821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:02.048688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:02.048974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:02.071571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:02.073231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebf981-c6a3-4e13-a1b2-85bfc9f2a975 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:02.101503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 861/1726] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:03.578322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:03.589656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:03.589656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:03.663716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] MFA Rules not processed for user `e000f3bac6a146238223d525f5717b63`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:03.664955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:03.841823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 866/1727] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:03.878394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba951-39a7-4b31-9df5-1a95c451e708 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:03.879264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba951-39a7-4b31-9df5-1a95c451e708 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:03.879673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba951-39a7-4b31-9df5-1a95c451e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:03.899715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-206ba951-39a7-4b31-9df5-1a95c451e708 None None] MFA Rules not processed for user `193d9e5225e6463ab359f019179c96fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:03.901802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-206ba951-39a7-4b31-9df5-1a95c451e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:03.911956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 862/1728] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:06.785867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:06.817881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724ca-7b68-4ef4-b29f-ca1b65ed5c43 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:06.818868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724ca-7b68-4ef4-b29f-ca1b65ed5c43 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:06.819553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d724ca-7b68-4ef4-b29f-ca1b65ed5c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:06.872141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a3d724ca-7b68-4ef4-b29f-ca1b65ed5c43 None None] MFA Rules not processed for user `1fc7c179028a457b93a02fa6fc440051`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:06.874125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a3d724ca-7b68-4ef4-b29f-ca1b65ed5c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:06.940961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d18a3-13c6-46d6-bfe1-78729fd94831 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:06.956034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:06.957111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:06.957780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:06.958404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] PATH_INFO: `/v3/users/d19d597749b04d04ab414abdf179d9cd` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:06.961986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19d597749b04d04ab414abdf179d9cd)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:06.964179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 863/1729] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:06.965811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:07.053738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19d597749b04d04ab414abdf179d9cd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:07.054959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19d597749b04d04ab414abdf179d9cd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:07.066878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19d597749b04d04ab414abdf179d9cd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:07.073504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19d597749b04d04ab414abdf179d9cd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:07.088952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19d597749b04d04ab414abdf179d9cd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:07.138695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 867/1730] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:06 2022] DELETE /identity/v3/users/d19d597749b04d04ab414abdf179d9cd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:07.332527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:07.333123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:07.333630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:07.439060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:07.440637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:07.677817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 864/1731] 10.222.0.45 () {58 vars in 1015 bytes} [Mon Feb 21 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:07.692441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:07.694162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:07.742205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:07.743648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:07.765345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4fea-1493-492e-9076-f207f17a222e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:07.787917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:07.790254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:07.799708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:07.800072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:07.832978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:07.841267 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:07.901377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 865/1732] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:07.938255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1940ae-28bf-42ff-930f-4c4ac619dff7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:07.953855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:07.955061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:07.956751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:07.957451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] PATH_INFO: `/v3/projects/6931a0f13ec746e8b51043634130c72a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:07.959937 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6931a0f13ec746e8b51043634130c72a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:07.962347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:08.043908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6931a0f13ec746e8b51043634130c72a', 'request_id': 'req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.059240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6931a0f13ec746e8b51043634130c72a', 'request_id': 'req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.077322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6931a0f13ec746e8b51043634130c72a', 'request_id': 'req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.110233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] The token cache is being invalidate because project 6931a0f13ec746e8b51043634130c72a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:08.110527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.114026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.119643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 868/1733] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:07 2022] DELETE /identity/v3/projects/6931a0f13ec746e8b51043634130c72a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:08.123696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:08.148362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28bb4f-93b3-44c0-b895-5de2a741432d service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:08.355748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:08.359197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:08.360111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:08.361974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] PATH_INFO: `/v3/users/e000f3bac6a146238223d525f5717b63` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:08.367567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e000f3bac6a146238223d525f5717b63)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:08.388813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:08.518773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e000f3bac6a146238223d525f5717b63'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.519648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e000f3bac6a146238223d525f5717b63'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.541739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e000f3bac6a146238223d525f5717b63'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.562644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e000f3bac6a146238223d525f5717b63'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.563399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e544f50e-e588-4158-9134-8f96af6f3740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e000f3bac6a146238223d525f5717b63'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:08.617146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 866/1734] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:08 2022] DELETE /identity/v3/users/e000f3bac6a146238223d525f5717b63 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:10.900645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:10.902131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:10.922889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67375bd5-3bcc-4c30-bfea-5e41f7b805a0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:11.039733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc595e5f-d5d4-4ded-a559-7cbc8d46689c None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.040307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc595e5f-d5d4-4ded-a559-7cbc8d46689c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.040307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc595e5f-d5d4-4ded-a559-7cbc8d46689c None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.042372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 867/1735] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:11:11.069949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ab00-81e5-46b5-9444-8342a3c4e952 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.070476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ab00-81e5-46b5-9444-8342a3c4e952 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.070897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554ab00-81e5-46b5-9444-8342a3c4e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.106020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:11.106910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.107192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.107918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] PATH_INFO: `/v3/projects/a0420ba2f5724a57ab833541efbd6004` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.117253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0420ba2f5724a57ab833541efbd6004)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:11.119307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:11.129935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-0554ab00-81e5-46b5-9444-8342a3c4e952 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:11.137672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0554ab00-81e5-46b5-9444-8342a3c4e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:11.313708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0420ba2f5724a57ab833541efbd6004', 'request_id': 'req-6a108252-0f39-46ba-b95e-4160d4ae6fdd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:11.342403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0420ba2f5724a57ab833541efbd6004', 'request_id': 'req-6a108252-0f39-46ba-b95e-4160d4ae6fdd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:11.357613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0420ba2f5724a57ab833541efbd6004', 'request_id': 'req-6a108252-0f39-46ba-b95e-4160d4ae6fdd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:11.359222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 868/1736] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:11.382972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] The token cache is being invalidate because project a0420ba2f5724a57ab833541efbd6004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:11.382972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:11.384071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:11.389097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 869/1737] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:10 2022] DELETE /identity/v3/projects/a0420ba2f5724a57ab833541efbd6004 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:11.392761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468979-f87d-4662-90e7-7fbdf0e3968b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.393821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468979-f87d-4662-90e7-7fbdf0e3968b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.394348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e468979-f87d-4662-90e7-7fbdf0e3968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.443662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-2e468979-f87d-4662-90e7-7fbdf0e3968b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:11.443662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2e468979-f87d-4662-90e7-7fbdf0e3968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:11.640524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 869/1738] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:11.642651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:11.644254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:11.664767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.664936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.667361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.746707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:11.746707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:11.769742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 870/1739] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:11.771159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:11.783872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53456ec1-96cf-4bc0-99a8-e5426ae06c5f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:11.805046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:11.806399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.806399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.806399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.806755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:11.807032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:11.809159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:11.871349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 871/1740] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:11:11.878441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:11.883830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a108252-0f39-46ba-b95e-4160d4ae6fdd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:11.907319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:11.908000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.908283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.910849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.915529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:11.928724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8cb6d-0e83-467a-8a7b-e21f5216046c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:11.974097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:11.975014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:11.975622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:11.976116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:11.976609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:11.976712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:11.977917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:11.990813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:12.040602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 870/1741] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:12.102022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:12.103823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 872/1742] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:11 2022] POST /identity/v3/projects => generated 363 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:12.154250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af86de-ebf2-494c-8367-b996fae77de8 service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:12.406665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:12.407695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:12.408175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:12.411866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:12.413366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:12.420591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:12.476442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 871/1743] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:12 2022] POST /identity/v3/users => generated 282 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:12.480206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:12.497596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470f73-1b76-402c-affb-3fe63a794c2b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:12.515179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:12.515556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:12.515874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:12.516274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:12.517002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:12.519224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:12.571321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:12.581233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 873/1744] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:12.584291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f013a0-d004-4422-adaa-61e9fe57f65b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:12.599812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:12.601903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:12.601903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:12.601903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:12.601903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:12.603563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa9ac8-7c35-495e-8571-0f66c6e7351b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:12.634410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 872/1745] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:12.635954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:12.657669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9f848-e2ec-4bdb-87e5-1e3990c2fe38 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:12.679946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:12.680854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:12.681162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:12.681445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] PATH_INFO: `/v3/projects/bbfc80d692a34e52a42e5c1396ad2f1c/users/a6abcce664ad4a9c95c71e13127ab280/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:12.723765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbfc80d692a34e52a42e5c1396ad2f1c, user_id=a6abcce664ad4a9c95c71e13127ab280, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:12.730045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:12.765086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 874/1746] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:12 2022] PUT /identity/v3/projects/bbfc80d692a34e52a42e5c1396ad2f1c/users/a6abcce664ad4a9c95c71e13127ab280/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:12.779873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:12.780414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:12.780961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:12.852757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] MFA Rules not processed for user `a6abcce664ad4a9c95c71e13127ab280`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:12.854230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:12.870237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:12.872960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:13.061360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb7bf-7696-4cc1-a316-6984a77816d0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.067953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 873/1747] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:13.074864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.078268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.081374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.081678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.081957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] PATH_INFO: `/v3/users/74c38843421e4d7484935d65af8a8c5f` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.084741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c38843421e4d7484935d65af8a8c5f)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.100958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.104732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbbfab-80e2-4c8f-9137-c740f7e0bd8d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.115467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.118388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.119181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.120763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.122626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.127392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.203178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 874/1748] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:13 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:13.206482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.261191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c38843421e4d7484935d65af8a8c5f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:13.262106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c38843421e4d7484935d65af8a8c5f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:13.299844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c38843421e4d7484935d65af8a8c5f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:13.319163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c38843421e4d7484935d65af8a8c5f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:13.320889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1caa1acb-3521-4d71-8d59-ef390111c7d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c38843421e4d7484935d65af8a8c5f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:13.347408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf00ca-0306-4797-8c87-64ba30cb52d6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.353908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.354723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.357915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.358168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 875/1749] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:12 2022] DELETE /identity/v3/users/74c38843421e4d7484935d65af8a8c5f => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:13.358254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.358254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.359086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.359746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.360341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.376865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.389933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 875/1750] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:13 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:13.395284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.397740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:13.416485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98905fb-a9fa-4b75-904a-53c270c193dd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.436483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:13.438696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:13.515333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.516493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.516918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.517456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.519004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.520742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.538567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 876/1751] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:13.543625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.579026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517599d-c404-45c7-aab1-69a4b587b494 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.601939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.603761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.604223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.605095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] PATH_INFO: `/v3/projects/e487dc320ddf4e1092544c8345564f45/users/a14fc499adbd4abfa6e261e940564221/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.638234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e487dc320ddf4e1092544c8345564f45, user_id=a14fc499adbd4abfa6e261e940564221, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.641874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.654129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 876/1752] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:13.682615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 877/1753] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:13 2022] PUT /identity/v3/projects/e487dc320ddf4e1092544c8345564f45/users/a14fc499adbd4abfa6e261e940564221/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:13.690526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.708391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf35ebc-ba19-436f-b660-a9467d06a29b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.727599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.729815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:13.853134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ac5a5-9ad5-4c12-9d5f-a6eb072a543d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.854775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.857847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.858134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.858411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.861406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.863623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.874037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.874758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.875117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.875387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.889307 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.890949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2fa772-0fe4-4c09-a047-e1609cc803b3 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.895309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 877/1754] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:13.898598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:13.911450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec9a76-b9ab-4cb1-b16f-1bb4d5af0483 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:13.916231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 878/1755] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:13.917384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:13.918357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.918785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.919126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] PATH_INFO: `/v3/projects/e487dc320ddf4e1092544c8345564f45/users/a14fc499adbd4abfa6e261e940564221/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.921539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e487dc320ddf4e1092544c8345564f45, user_id=a14fc499adbd4abfa6e261e940564221, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:13.925174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:13.949135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 878/1756] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:13 2022] PUT /identity/v3/projects/e487dc320ddf4e1092544c8345564f45/users/a14fc499adbd4abfa6e261e940564221/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:13.960196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db64f-b906-40b2-bfd0-26968585667f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:13.960196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db64f-b906-40b2-bfd0-26968585667f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:13.960196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db64f-b906-40b2-bfd0-26968585667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:13.995039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-616db64f-b906-40b2-bfd0-26968585667f None None] MFA Rules not processed for user `a14fc499adbd4abfa6e261e940564221`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:13.996382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-616db64f-b906-40b2-bfd0-26968585667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.117294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 879/1757] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:14.136714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:14.139263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.224449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb194e-e1dd-4e3c-b889-7b5b52719693 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:14.233516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:14.235026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.235692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db64f-b906-40b2-bfd0-26968585667f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:14.236322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.237362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.237915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-616db64f-b906-40b2-bfd0-26968585667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.257136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:14.258854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091af3f-25b9-432c-bf1f-bc5eb8c0f6af service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:14.282795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 879/1758] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:14.405616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db64f-b906-40b2-bfd0-26968585667f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:14.411660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:14.412781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.413081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.413512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] PATH_INFO: `/v3/users/977a7348d1774e62a7317f516d08e795` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.415054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=977a7348d1774e62a7317f516d08e795)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:14.417371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:14.487169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977a7348d1774e62a7317f516d08e795'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.488149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977a7348d1774e62a7317f516d08e795'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.506273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977a7348d1774e62a7317f516d08e795'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.507825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977a7348d1774e62a7317f516d08e795'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.519232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977a7348d1774e62a7317f516d08e795'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.562282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 880/1759] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:14 2022] DELETE /identity/v3/users/977a7348d1774e62a7317f516d08e795 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:14.570659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.571187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.571760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.593590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:14.595535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.631598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:14.638089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.757702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ccf11-f97f-49c8-857d-742f63f175c8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:14.793847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:14.794906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.795304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.795777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] PATH_INFO: `/v3/users/a6abcce664ad4a9c95c71e13127ab280` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.798544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6abcce664ad4a9c95c71e13127ab280)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:14.802064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:14.804006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 880/1760] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:14.820024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:14.823737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.912632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6abcce664ad4a9c95c71e13127ab280'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.913490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6abcce664ad4a9c95c71e13127ab280'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.931555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6abcce664ad4a9c95c71e13127ab280'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.932360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6abcce664ad4a9c95c71e13127ab280'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.942872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4ed79382-3ed6-4d93-b2d1-7e57e73a1dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6abcce664ad4a9c95c71e13127ab280'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:14.953603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684c4dc-293f-4257-a3d7-9ec780e6a608 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:14.965838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:14.966768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 881/1761] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:14 2022] DELETE /identity/v3/users/a6abcce664ad4a9c95c71e13127ab280 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:14.971587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.972020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.972308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.973580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:14.974565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:14.975071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:14.977514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:14.993349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:14.996273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:15.008140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:15.009419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:15.009913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 881/1762] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:15.076203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 882/1763] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:15.087752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:15.094763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:15.108202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34847499-317a-41d3-821f-caf4db3095cd service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:15.169882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:15.170694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:15.171063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:15.171430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:15.182514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:15.184273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:15.198084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 882/1764] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:15.664075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:15.665619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:15.690572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc1bc4-6f2a-4d10-9edc-a8db73838adc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:15.697119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:15.700096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:15.700096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:15.700096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] PATH_INFO: `/v3/projects/cf7c552b203f42dd8313e65dd5f04093` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:15.700408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7c552b203f42dd8313e65dd5f04093)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:15.702551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:15.773207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7c552b203f42dd8313e65dd5f04093', 'request_id': 'req-7a1b2ea5-a342-4747-ae15-78c9459368d7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:15.786107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7c552b203f42dd8313e65dd5f04093', 'request_id': 'req-7a1b2ea5-a342-4747-ae15-78c9459368d7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:15.794551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7c552b203f42dd8313e65dd5f04093', 'request_id': 'req-7a1b2ea5-a342-4747-ae15-78c9459368d7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:15.820490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] The token cache is being invalidate because project cf7c552b203f42dd8313e65dd5f04093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:15.820826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:15.821512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:15.824222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 883/1765] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:15 2022] DELETE /identity/v3/projects/cf7c552b203f42dd8313e65dd5f04093 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:15.828030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:15.838857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a7cc0-ec39-4bde-98a1-8b7bdaf173e8 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:15.907564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:15.909211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:15.909498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:15.910516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] PATH_INFO: `/v3/users/4bec1fa02f954b9a8c526edd1a449796` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:15.912613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bec1fa02f954b9a8c526edd1a449796)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:15.915738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:16.009629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bec1fa02f954b9a8c526edd1a449796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.010389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bec1fa02f954b9a8c526edd1a449796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.027498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bec1fa02f954b9a8c526edd1a449796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.040376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bec1fa02f954b9a8c526edd1a449796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.041857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bec1fa02f954b9a8c526edd1a449796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.068120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 883/1766] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:15 2022] DELETE /identity/v3/users/4bec1fa02f954b9a8c526edd1a449796 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:16.164985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:16.166491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:16.180363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b2ea5-a342-4747-ae15-78c9459368d7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:16.251213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:16.253649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:16.254709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:16.255675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] PATH_INFO: `/v3/projects/bbfc80d692a34e52a42e5c1396ad2f1c` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:16.259335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbfc80d692a34e52a42e5c1396ad2f1c)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:16.263197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:16.333901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:16.335625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:16.378174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5b4cf-c475-4bd2-977b-d8f59436d7d7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:16.388943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbfc80d692a34e52a42e5c1396ad2f1c', 'request_id': 'req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.417219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbfc80d692a34e52a42e5c1396ad2f1c', 'request_id': 'req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.433694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbfc80d692a34e52a42e5c1396ad2f1c', 'request_id': 'req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.465222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] The token cache is being invalidate because project bbfc80d692a34e52a42e5c1396ad2f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:16.468278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.470489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.477249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 884/1767] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:16 2022] DELETE /identity/v3/projects/bbfc80d692a34e52a42e5c1396ad2f1c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:16.486894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:16.488236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:16.513383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:16.514506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:16.514951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:16.515551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] PATH_INFO: `/v3/projects/425aa79ed70a453eb53f71930c0411c6` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:16.518627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425aa79ed70a453eb53f71930c0411c6)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:16.522069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:16.606857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dee7fd-6e55-4f4c-ae46-3a0aeffa95b4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:16.616742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425aa79ed70a453eb53f71930c0411c6', 'request_id': 'req-05b4278d-8025-4946-b796-01f1c1800ed4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.629615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425aa79ed70a453eb53f71930c0411c6', 'request_id': 'req-05b4278d-8025-4946-b796-01f1c1800ed4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.646489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425aa79ed70a453eb53f71930c0411c6', 'request_id': 'req-05b4278d-8025-4946-b796-01f1c1800ed4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.666853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] The token cache is being invalidate because project 425aa79ed70a453eb53f71930c0411c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:16.667144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.667895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.673615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 884/1768] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:16 2022] DELETE /identity/v3/projects/425aa79ed70a453eb53f71930c0411c6 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:16.674805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:16.676431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:16.748467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:16.749430 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:16.749643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:16.749917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] PATH_INFO: `/v3/users/a14fc499adbd4abfa6e261e940564221` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:16.755085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14fc499adbd4abfa6e261e940564221)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:16.757405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:16.802814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4278d-8025-4946-b796-01f1c1800ed4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:16.820949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:16.821855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:16.822132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:16.822410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] PATH_INFO: `/v3/users/e855063d5e4f45fb8784c3c5c1aecf19` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:16.825517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e855063d5e4f45fb8784c3c5c1aecf19)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:16.828800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:16.848980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14fc499adbd4abfa6e261e940564221'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.849638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14fc499adbd4abfa6e261e940564221'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.863148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14fc499adbd4abfa6e261e940564221'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.863546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14fc499adbd4abfa6e261e940564221'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.874850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14fc499adbd4abfa6e261e940564221'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.914015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 885/1769] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:16 2022] DELETE /identity/v3/users/a14fc499adbd4abfa6e261e940564221 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:16.924436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e855063d5e4f45fb8784c3c5c1aecf19'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.925305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e855063d5e4f45fb8784c3c5c1aecf19'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.941933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e855063d5e4f45fb8784c3c5c1aecf19'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.954325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e855063d5e4f45fb8784c3c5c1aecf19'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.955017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e855063d5e4f45fb8784c3c5c1aecf19'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:16.970429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 885/1770] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:16 2022] DELETE /identity/v3/users/e855063d5e4f45fb8784c3c5c1aecf19 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:17.045387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.047234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.166811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.168412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.218734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dc8dd-3c30-449d-9cc9-9062f281e62a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.292744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b480f3-8927-403e-8a9c-030df8d6581f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.298541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.300313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.300589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.300911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] PATH_INFO: `/v3/users/8d0f95158ea04255a0bf6ca81852352a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.303569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0f95158ea04255a0bf6ca81852352a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.305730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.373109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.378829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.379133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.381835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] PATH_INFO: `/v3/projects/70f393c409b04bb18fc1b30783d53567` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.384525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f393c409b04bb18fc1b30783d53567)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.391457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.411233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0f95158ea04255a0bf6ca81852352a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.413802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0f95158ea04255a0bf6ca81852352a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.446572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0f95158ea04255a0bf6ca81852352a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.461340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0f95158ea04255a0bf6ca81852352a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.462131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a53e495e-d240-4427-ad8e-e77288641747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0f95158ea04255a0bf6ca81852352a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.482570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 886/1771] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:17 2022] DELETE /identity/v3/users/8d0f95158ea04255a0bf6ca81852352a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:17.484183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0134-16e6-4770-ac7c-00af968c2cec None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.484473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0134-16e6-4770-ac7c-00af968c2cec None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.484937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f0134-16e6-4770-ac7c-00af968c2cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.488868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f393c409b04bb18fc1b30783d53567', 'request_id': 'req-d7613c74-39a1-4c2e-a623-530d9632ecd4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.499488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f393c409b04bb18fc1b30783d53567', 'request_id': 'req-d7613c74-39a1-4c2e-a623-530d9632ecd4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.507820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7b5f0134-16e6-4770-ac7c-00af968c2cec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:17.509384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7b5f0134-16e6-4770-ac7c-00af968c2cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.511146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f393c409b04bb18fc1b30783d53567', 'request_id': 'req-d7613c74-39a1-4c2e-a623-530d9632ecd4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.527392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] The token cache is being invalidate because project 70f393c409b04bb18fc1b30783d53567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:17.528251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.529224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7613c74-39a1-4c2e-a623-530d9632ecd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:17.531392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 886/1772] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:17 2022] DELETE /identity/v3/projects/70f393c409b04bb18fc1b30783d53567 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:17.538231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.539248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.539851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.578211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:17.579951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.580812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 887/1773] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:17.593121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 887/1774] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:17.603035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.603533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.603903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.606798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.609767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.636677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:17.638190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.653743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 888/1775] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:17.655043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.685592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93cda5-4c3d-419c-8f3c-84e1b16db3bb None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.701506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.702953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.703709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.703709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.706500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:17.706879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.708752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15313f8-c13c-47f6-8e51-350789d106da None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.709208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.712954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.713742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.714122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.714494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.725671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.726896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 889/1776] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:17.731462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.731904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.756372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 888/1777] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:17.759011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03537a31-6c54-4b04-a019-5782d5137d0b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.767249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.768487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.768758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.769040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.770075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.775316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.810411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 890/1778] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:17 2022] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:17.814261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.827256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae1052-a5bc-4646-b0c1-14d4d4c525f9 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:17.892462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.898765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.943289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:17.944325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:17.944831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:17.945639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:17.946344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:17.948512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:17.973903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 889/1779] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:17 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:17.974732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:17.976241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:17.990037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d775b74-f1d6-486d-bef8-3f816c9ee907 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.003650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.006901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.009078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.009399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] PATH_INFO: `/v3/projects/7b7d8341a1704825b6d9d7864320414b` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.011254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7d8341a1704825b6d9d7864320414b)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.013478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.030493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9091df-4b8f-48b0-bdab-d76f35616f4e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.038197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.040452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.040746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.041023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] PATH_INFO: `/v3/projects/e487dc320ddf4e1092544c8345564f45` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.043996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e487dc320ddf4e1092544c8345564f45)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.047150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.087630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7d8341a1704825b6d9d7864320414b', 'request_id': 'req-31e21aa1-f172-48e1-8040-211310686045'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.101618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7d8341a1704825b6d9d7864320414b', 'request_id': 'req-31e21aa1-f172-48e1-8040-211310686045'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.118085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7d8341a1704825b6d9d7864320414b', 'request_id': 'req-31e21aa1-f172-48e1-8040-211310686045'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.131381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] The token cache is being invalidate because project 7b7d8341a1704825b6d9d7864320414b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:18.131812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.133094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.134638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e487dc320ddf4e1092544c8345564f45', 'request_id': 'req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.135686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 890/1780] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:17 2022] DELETE /identity/v3/projects/7b7d8341a1704825b6d9d7864320414b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:18.137489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.139906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.144282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e487dc320ddf4e1092544c8345564f45', 'request_id': 'req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.161901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e487dc320ddf4e1092544c8345564f45', 'request_id': 'req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.177736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] The token cache is being invalidate because project e487dc320ddf4e1092544c8345564f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:18.178542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.179374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a4ad7fa1-d0c0-47c3-904d-3b251f7014e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.182185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 891/1781] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:17 2022] DELETE /identity/v3/projects/e487dc320ddf4e1092544c8345564f45 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:18.183798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aa73-71dc-4900-8f41-df72690a2890 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.184244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aa73-71dc-4900-8f41-df72690a2890 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.184643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06aa73-71dc-4900-8f41-df72690a2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.219198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-de06aa73-71dc-4900-8f41-df72690a2890 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.221209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-de06aa73-71dc-4900-8f41-df72690a2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.237932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e21aa1-f172-48e1-8040-211310686045 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.307863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 892/1782] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.310055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283102c-caff-4813-85e1-439dc57dcbfc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.310557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283102c-caff-4813-85e1-439dc57dcbfc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.311029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283102c-caff-4813-85e1-439dc57dcbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.320624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.321333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.321621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.321897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.322767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.324364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.336365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7283102c-caff-4813-85e1-439dc57dcbfc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.337964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7283102c-caff-4813-85e1-439dc57dcbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.338114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 891/1783] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:18.338756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.340451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.348654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 893/1784] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.350977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.351302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.351585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.366982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a0bbb-ae98-4505-9b34-a0fb655fb7a3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.373356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.374357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.374646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.374924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] PATH_INFO: `/v3/projects/c8fcf33e45c749a4ada612b80f852b66` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.377629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fcf33e45c749a4ada612b80f852b66)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.379832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.380390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.392016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.412303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 894/1785] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.413327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.414942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.430285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d9d9-6266-429f-8ac5-55a3a61bf266 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.438134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.439208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.440195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.440384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.441170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.443116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9d594-b44b-46cd-a747-fd059d4c58e8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.458650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 895/1786] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:18.460129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.460421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.460708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.475466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fcf33e45c749a4ada612b80f852b66', 'request_id': 'req-5be842fa-eca4-442b-872f-56d28def26c4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.481390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.482793 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.487580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fcf33e45c749a4ada612b80f852b66', 'request_id': 'req-5be842fa-eca4-442b-872f-56d28def26c4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.495663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fcf33e45c749a4ada612b80f852b66', 'request_id': 'req-5be842fa-eca4-442b-872f-56d28def26c4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.508688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] The token cache is being invalidate because project c8fcf33e45c749a4ada612b80f852b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:18.509281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.510108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5be842fa-eca4-442b-872f-56d28def26c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:18.515876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 892/1787] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:18 2022] DELETE /identity/v3/projects/c8fcf33e45c749a4ada612b80f852b66 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:18.517609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.518058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.518480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.521085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 893/1788] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:11:18.522137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.524077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.554982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 896/1789] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.555669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.557323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.569194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1e91f-482d-4bd5-834f-4c0ea719cf1e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.573845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.574719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.575001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.575269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] PATH_INFO: `/v3/projects/cd9f627462404820b7133197d8850ab1/users/20c4e5d75f694c33950aaeb4354064b2/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.590354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9f627462404820b7133197d8850ab1, user_id=20c4e5d75f694c33950aaeb4354064b2, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.592965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1476f8-6b5b-451e-b0ca-bca681e6f277 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.603059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c6461-6ab6-4e0c-9eaa-ce68b30d23b2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.608227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 897/1790] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:18 2022] PUT /identity/v3/projects/cd9f627462404820b7133197d8850ab1/users/20c4e5d75f694c33950aaeb4354064b2/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:18.609377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.610386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.610386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.630717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.631758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.671795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.672715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.672794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.673124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.674863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:18.674863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.676397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d697e-f7e2-4cb1-8af2-8e8293fa2714 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.688848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 894/1791] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:18.690599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.691139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.691418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.699808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 898/1792] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.702292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.711377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.712599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.717049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b42836-133a-484a-90a2-566cbb050a4b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.723377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.724041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.724323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.724599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.725639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:18.725639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.727230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1b96-c55b-4146-8229-8860a8e801c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.740750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 899/1793] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:18.742145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.742498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.742852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.775896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] MFA Rules not processed for user `20c4e5d75f694c33950aaeb4354064b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.777383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.789452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 895/1794] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.790823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.801241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2bd82-728b-4131-9ca9-92f016075ee8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.806247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.806825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.807099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.807380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.808073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.810017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80a94a-f31b-4508-a5a9-bc2ee5d2180b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.836708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 896/1795] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:18.841096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.841465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.841806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.859331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 900/1796] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.860572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.863816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:18.865149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:18.874648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a22089-99c1-47ff-9a0b-e3f8abd0a697 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.935736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 897/1797] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:18.935736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.938722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.939790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.939908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.940211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.940774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.942824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.946906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa0a69-b030-4a52-951e-43d0e0327ef8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:18.952979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:18.953813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:18.954763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:18.955431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:18.956584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:18.959099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:18.976778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 901/1798] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:18.978397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:18.997062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 898/1799] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/users => generated 285 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:18.997062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.010409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85def0-0a2f-4b31-b936-8dd943a93619 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.065654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e91a96-925d-40b8-b9b0-24f29d7a83b0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.073028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.074061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.074504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.074929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.075760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.077821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.078669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.079464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.079862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.080754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.081704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:19.082123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.083993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.100842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 899/1800] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:19.101982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.113161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ab185-4890-445e-85f4-107d83221ba3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.113516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 902/1801] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:18 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.114368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.181146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.182061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.182436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.182809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.183615 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.185682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.189995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa348e-9002-40ba-8cee-543433d3b37a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.194870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.195651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.195934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.196206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.196936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.198710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.210329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 903/1802] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.211007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.214508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:19.228640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 900/1803] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.228640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.238715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee274-ef45-4914-b545-f520f2adb8e1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.243730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.244472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.244915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.245293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.246849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.249190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.279376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 901/1804] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.280548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.301190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c060e-6c4e-45f1-b346-ed98f2652910 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.349326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd22b-54a0-4a8e-9e8a-c69f87c2c8e1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.354320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.355021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.355308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.355592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.356378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.358792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.375243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.376398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.376817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.377671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.393418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 902/1805] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.394344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.400434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.406232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a408-8b04-4bfa-93aa-b17091782689 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.406738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.411953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.412881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.413020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.413404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.414194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.415856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.421673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 904/1806] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:19.423289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.429168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 903/1807] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.430177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.441087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f4f9b-7375-4cfc-9a77-18274bcd2926 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.442551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae4703-3b6e-4ec4-b027-eb77770c79dc service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.445952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.446616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.446895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.447166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.447852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.449925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.450550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.451420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.451893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.452399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.453265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.457568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.475114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 905/1808] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.476322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.478220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 904/1809] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.479147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.492906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2f0b2-5440-4180-9d1d-d31b143f12b8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.498435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.499140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.499429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.499856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] PATH_INFO: `/v3/projects/64d3d4f7a6e34697b62d9b6cbe04af52/users/fd1c03a6e240492f8917b942c85f28b3/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.516606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242395d4-5fde-45a2-a79e-cd332361504d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.517024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3d4f7a6e34697b62d9b6cbe04af52, user_id=fd1c03a6e240492f8917b942c85f28b3, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.520382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.530866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.532836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.533659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.534157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.535396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.537542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 905/1810] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:19 2022] PUT /identity/v3/projects/64d3d4f7a6e34697b62d9b6cbe04af52/users/fd1c03a6e240492f8917b942c85f28b3/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:19.538319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.538463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.551725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 906/1811] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.553285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.565763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0886a8f-0002-419b-9cc6-c8779d3dcc18 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.610231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5258dcd-b9b7-454c-b144-94663cef58a8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.615133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.615809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.616170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.616416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.617111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.618710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d91844-a454-432d-88b4-409dba5687f6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.624240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.625018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.625413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.626026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.627522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.629360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.630441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 906/1812] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.631647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.631932 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.632207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.640813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 907/1813] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.641976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.652570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829f47-fd44-418a-94c7-45a3580f2955 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.657624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.658565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.658843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.659120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] PATH_INFO: `/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520/users/edbe159d50ec4cc7b35b03e590b374eb/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.661188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] MFA Rules not processed for user `fd1c03a6e240492f8917b942c85f28b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:19.662702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:19.675504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e057ae4ffd6b48d39b8e29d4410f1520, user_id=edbe159d50ec4cc7b35b03e590b374eb, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.678522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.697180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 908/1814] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:19 2022] PUT /identity/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520/users/edbe159d50ec4cc7b35b03e590b374eb/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:19.698106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.730536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 907/1815] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:19.731408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.741817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b805f8b-9f06-4f5a-adaa-1ff993fe6b58 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.768489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7fc63-4882-4231-a4a5-76fe5bdf13fe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.773682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.774713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.775126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.775494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] PATH_INFO: `/v3/projects/a224aea079994bedb0f831b75e3e11a5/users/bd49f0aa177049e881fc847fc4adaf17/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.794344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a224aea079994bedb0f831b75e3e11a5, user_id=bd49f0aa177049e881fc847fc4adaf17, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.797978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.805203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.805951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.806353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.806613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.807414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.809120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.820808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 908/1816] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.821527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.822160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 909/1817] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:19 2022] PUT /identity/v3/projects/a224aea079994bedb0f831b75e3e11a5/users/bd49f0aa177049e881fc847fc4adaf17/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:19.823068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.831173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff8ba7-fc93-4233-96d8-73eb91fab752 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.893499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.894163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.894442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.894713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.895480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.897243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.898619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6f5eb-a0c1-4a0f-a8c7-86b514580ee4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.903833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.904834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.905144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.905423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.906107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.907755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 909/1818] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:19.908695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.911111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019292c-c63e-41fe-9f43-d40816245955 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.920453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c08b-eaea-4b96-affd-610b7a49ba9b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:19.927531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:19.928697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.929207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.929562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] PATH_INFO: `/v3/projects/b28907c12ae542b4a959169ab0c7b04e/users/a4eed26fba184f189abb4ae9b6fb3ab6/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.945994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 910/1819] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:19.945994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:19.945994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:19.945994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:19.950016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28907c12ae542b4a959169ab0c7b04e, user_id=a4eed26fba184f189abb4ae9b6fb3ab6, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:19.953363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:19.977940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 910/1820] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:19 2022] PUT /identity/v3/projects/b28907c12ae542b4a959169ab0c7b04e/users/a4eed26fba184f189abb4ae9b6fb3ab6/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:19.977940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:19.979499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] MFA Rules not processed for user `bd49f0aa177049e881fc847fc4adaf17`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:19.980882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:20.047657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b410-86a8-4796-8a42-cf84c3bb7f97 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.067828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 911/1821] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:20.068027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.068227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.068342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.068342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.068342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] PATH_INFO: `/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520/users/edbe159d50ec4cc7b35b03e590b374eb/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.070439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e057ae4ffd6b48d39b8e29d4410f1520, user_id=edbe159d50ec4cc7b35b03e590b374eb, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.075195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f55d6-b840-4576-9e1e-de52243a90c2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.080875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a31f9-ed8b-4e29-8f06-afae2bd35af7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.086526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.087454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.087880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.088479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.089411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.091719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.110963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 911/1822] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:19 2022] PUT /identity/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520/users/edbe159d50ec4cc7b35b03e590b374eb/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:20.110963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07e8f-8cc6-443f-a1fb-0449ede67bd5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.110963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07e8f-8cc6-443f-a1fb-0449ede67bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.110963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c07e8f-8cc6-443f-a1fb-0449ede67bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.132464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 912/1823] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/users => generated 291 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:20.134917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.143272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-49c07e8f-8cc6-443f-a1fb-0449ede67bd5 None None] MFA Rules not processed for user `a4eed26fba184f189abb4ae9b6fb3ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:20.146113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-49c07e8f-8cc6-443f-a1fb-0449ede67bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:20.150871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610cae45-ab9f-4b8d-82cb-3d6b79355745 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.218493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.218678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 912/1824] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:20.219112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.219344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.219718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.219805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.220040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.220314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.220406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.223219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.256925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] MFA Rules not processed for user `edbe159d50ec4cc7b35b03e590b374eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:20.258333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:20.262176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 913/1825] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:20.263030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.344561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdcb7c-d31a-49e5-88f9-afc578dd51ac admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.351704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.352785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.353436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.353804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.354631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.356978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.377560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 914/1826] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:20.379831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.384287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 913/1827] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:20.384287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.396359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd037e-1732-4837-b0b5-9a7a56d29db8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.400730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec5fb1-5713-4a2c-b886-314734fda16f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.401582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.402318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.402642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.402927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.403621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.405664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.407998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.409455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.409801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.410138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.410900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.412867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.436722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 914/1828] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:20.437411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.448775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b2b0-e151-4618-b4c8-e120d962a8a2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.452809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 915/1829] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:20.452809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.452809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:20.510756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.511628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067130da-54e3-47c3-8297-a357178b6a16 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.511863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.512220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.512568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] PATH_INFO: `/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e/users/17b160b5205e44a0bad8968348a1ae47/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.515662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.516398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.516741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.517168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.529409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b3cda16a2c47e9bc6649a4ca9e142e, user_id=17b160b5205e44a0bad8968348a1ae47, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.532331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.547898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 915/1830] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:20 2022] PUT /identity/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e/users/17b160b5205e44a0bad8968348a1ae47/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:20.548660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.584625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.586199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.598099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 916/1831] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:20.599002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.610826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dca33-38f4-4da6-8b19-4afa59843b4f service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.616458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e7f1d-a45f-46a0-ae32-a0b5f1972377 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.617409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.618094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.618401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.618736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.619464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.621842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.622700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.623593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.623955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.624306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.625297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.627333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.648219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 917/1832] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/users => generated 300 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:20.648219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.656053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a56f-9050-4594-918a-747bbd330496 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.661617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.662333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.662604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 916/1833] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:20.662715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.662898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.663600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.666872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.667266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.678516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 918/1834] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:20.683822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.683959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed556-0f65-467e-b504-e024f8dbca17 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.689793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.690057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e9664-9810-4def-8993-98a116977ddf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.690817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.691106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.691611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.692359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.694007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.695895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.697024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.697464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.697879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] PATH_INFO: `/v3/projects/24f7d42c0d4342099f20a66da680dadd/users/c53a2f814a474b908016162ac9530d63/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.704677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 917/1835] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:20.706775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.715118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f7d42c0d4342099f20a66da680dadd, user_id=c53a2f814a474b908016162ac9530d63, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.717797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.724097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ab665-5d27-43cc-a05d-f78b05104bfc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.730334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.731229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.731516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.731798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] PATH_INFO: `/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e/users/17b160b5205e44a0bad8968348a1ae47/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.733948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b3cda16a2c47e9bc6649a4ca9e142e, user_id=17b160b5205e44a0bad8968348a1ae47, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.737138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 919/1836] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:20 2022] PUT /identity/v3/projects/24f7d42c0d4342099f20a66da680dadd/users/c53a2f814a474b908016162ac9530d63/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:20.737138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.737333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.748761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 918/1837] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:20 2022] PUT /identity/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e/users/17b160b5205e44a0bad8968348a1ae47/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:20.749593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.811548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9861c2b-f46a-4d19-b597-dc26d3763f5f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.821432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70b853-346f-4fb5-ab4f-9fdcfd462d45 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.827153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.828130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.828420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.828694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] PATH_INFO: `/v3/projects/b10f485c85784ad5ab0905008129657f/users/133033019ba7436eb390cd3fdfaa8c16/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.845074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10f485c85784ad5ab0905008129657f, user_id=133033019ba7436eb390cd3fdfaa8c16, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.848501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.864344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 919/1838] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:20 2022] PUT /identity/v3/projects/b10f485c85784ad5ab0905008129657f/users/133033019ba7436eb390cd3fdfaa8c16/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:20.865452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.871211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.872109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.872463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.872810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.934883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.936412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508d9b-df36-4cc2-90d2-35386891eabc service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.938654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcced28-4597-49fb-bfeb-3ee1e4c38bef admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.945411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:20.946148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 920/1839] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:20.947430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308878-b5de-43c0-baa9-dd90dfce7d87 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.947709 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:20.947818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308878-b5de-43c0-baa9-dd90dfce7d87 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.948051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c308878-b5de-43c0-baa9-dd90dfce7d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.948468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:20.948884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:20.949780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:20.951524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:20.968607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 920/1840] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:20.968607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:20.977416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-5c308878-b5de-43c0-baa9-dd90dfce7d87 None None] MFA Rules not processed for user `17b160b5205e44a0bad8968348a1ae47`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:20.978660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5c308878-b5de-43c0-baa9-dd90dfce7d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:20.981866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab99fd9-7ca3-4e10-b237-2135e1a6f7d1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:20.993907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.001148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.002610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.003132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.004252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.007099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.025412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 921/1841] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:21.025412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.041620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7710e-2d0b-4db8-9d6f-70a1ac18d97b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.048436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.049772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.049902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.050185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] PATH_INFO: `/v3/projects/24f7d42c0d4342099f20a66da680dadd/users/c53a2f814a474b908016162ac9530d63/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.052648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f7d42c0d4342099f20a66da680dadd, user_id=c53a2f814a474b908016162ac9530d63, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.055433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.086588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 922/1842] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:21 2022] PUT /identity/v3/projects/24f7d42c0d4342099f20a66da680dadd/users/c53a2f814a474b908016162ac9530d63/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:21.086588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.141173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 921/1843] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:21.144286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0478d-af40-4721-84f2-847ac8c73099 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.144745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0478d-af40-4721-84f2-847ac8c73099 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.145154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0478d-af40-4721-84f2-847ac8c73099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.196861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17765898-85f3-42e4-a03e-fd27c16bf236 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.202759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.203667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.204019 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.205675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] PATH_INFO: `/v3/projects/b10f485c85784ad5ab0905008129657f/users/133033019ba7436eb390cd3fdfaa8c16/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.207952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10f485c85784ad5ab0905008129657f, user_id=133033019ba7436eb390cd3fdfaa8c16, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.210850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.225258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 923/1844] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:21 2022] PUT /identity/v3/projects/b10f485c85784ad5ab0905008129657f/users/133033019ba7436eb390cd3fdfaa8c16/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:21.225258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.234763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:21.238082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c6a0478d-af40-4721-84f2-847ac8c73099 None None] MFA Rules not processed for user `c53a2f814a474b908016162ac9530d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:21.240053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c6a0478d-af40-4721-84f2-847ac8c73099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:21.342334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6bc4-a6f5-4a1a-8678-591aead20410 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.347036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.347701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.347986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.348267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.366246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 922/1845] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:21.368498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.368914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.369418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.407323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] MFA Rules not processed for user `133033019ba7436eb390cd3fdfaa8c16`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:21.408651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:21.481737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.483523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.496283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 924/1846] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:21.497230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.506202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187a087-08cf-40ad-b50e-c703a89541ad service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.506984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 923/1847] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:21.515269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.515936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.516222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.516558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.552170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.565366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3378e-d74e-42c7-83d4-589c6b0f104b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.570163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.571199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.571713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.572216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.584837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.586965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.594069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.595588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e3c2c-1ad9-4531-a0e4-bcef9a8d02e7 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.600261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 924/1848] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:21.618095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 925/1849] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:21.719477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:21.844181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc0ae1-dffd-4d89-bf9c-436afc5c3a9e service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:21.851398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:21.852407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:21.852753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:21.853167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] PATH_INFO: `/v3/users/a4eed26fba184f189abb4ae9b6fb3ab6` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:21.854457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4eed26fba184f189abb4ae9b6fb3ab6)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:21.856434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:21.936630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4eed26fba184f189abb4ae9b6fb3ab6'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:21.937607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4eed26fba184f189abb4ae9b6fb3ab6'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:21.957626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4eed26fba184f189abb4ae9b6fb3ab6'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:21.982271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4eed26fba184f189abb4ae9b6fb3ab6'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:21.987418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4eed26fba184f189abb4ae9b6fb3ab6'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.013221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 925/1850] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:21 2022] DELETE /identity/v3/users/a4eed26fba184f189abb4ae9b6fb3ab6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:22.018449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:22.018908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:22.018908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:22.057766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:22.058978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:22.208111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 926/1851] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:22.218527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:22.221398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:22.291641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344cac-e8bc-44ea-b97f-1c1fc15be7fd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:22.296368 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:22.297331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:22.297979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:22.298458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:22.312739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:22.315574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:22.328011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 926/1852] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:22.796926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:22.799417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:22.817724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a3e7f-aba5-42b4-aaeb-5b462967af8b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:22.823022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:22.823888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:22.824174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:22.824443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] PATH_INFO: `/v3/projects/b28907c12ae542b4a959169ab0c7b04e` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:22.825701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28907c12ae542b4a959169ab0c7b04e)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:22.827613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:22.903067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28907c12ae542b4a959169ab0c7b04e', 'request_id': 'req-b0271d7e-c563-4d65-ad27-f70f3e8bc762'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.915704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28907c12ae542b4a959169ab0c7b04e', 'request_id': 'req-b0271d7e-c563-4d65-ad27-f70f3e8bc762'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.924297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28907c12ae542b4a959169ab0c7b04e', 'request_id': 'req-b0271d7e-c563-4d65-ad27-f70f3e8bc762'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.938418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] The token cache is being invalidate because project b28907c12ae542b4a959169ab0c7b04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:22.938713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.939936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:22.941556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 927/1853] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:22 2022] DELETE /identity/v3/projects/b28907c12ae542b4a959169ab0c7b04e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:22.945708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:22.956010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc91a-b8c0-4d77-901d-b3b5e4ecf81c service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.031008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.031975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.032378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.032719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] PATH_INFO: `/v3/users/133033019ba7436eb390cd3fdfaa8c16` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.034198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=133033019ba7436eb390cd3fdfaa8c16)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.036096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.145451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133033019ba7436eb390cd3fdfaa8c16'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.146419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133033019ba7436eb390cd3fdfaa8c16'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.171428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133033019ba7436eb390cd3fdfaa8c16'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.183113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133033019ba7436eb390cd3fdfaa8c16'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.184632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133033019ba7436eb390cd3fdfaa8c16'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.206426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 927/1854] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:22 2022] DELETE /identity/v3/users/133033019ba7436eb390cd3fdfaa8c16 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:23.482787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.484778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.498056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271d7e-c563-4d65-ad27-f70f3e8bc762 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.565627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.571141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.571722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.572255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] PATH_INFO: `/v3/users/fd1c03a6e240492f8917b942c85f28b3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.574031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1c03a6e240492f8917b942c85f28b3)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.576528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.596256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.600896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.617231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9485-ec38-49f0-87a6-e3edc8e22ee1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.625383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.627807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.628457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.629016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] PATH_INFO: `/v3/projects/b10f485c85784ad5ab0905008129657f` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.630508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10f485c85784ad5ab0905008129657f)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.633089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.651012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1c03a6e240492f8917b942c85f28b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.651641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1c03a6e240492f8917b942c85f28b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.661987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1c03a6e240492f8917b942c85f28b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.662795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1c03a6e240492f8917b942c85f28b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.671997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-142a3714-b884-477b-ac63-8efc5d9bdb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1c03a6e240492f8917b942c85f28b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.689752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10f485c85784ad5ab0905008129657f', 'request_id': 'req-8f666b9b-562c-46d2-9edc-6ef7be613bbe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.691996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 928/1855] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:23 2022] DELETE /identity/v3/users/fd1c03a6e240492f8917b942c85f28b3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:23.695653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10f485c85784ad5ab0905008129657f', 'request_id': 'req-8f666b9b-562c-46d2-9edc-6ef7be613bbe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.696223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.696574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.697142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.704724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10f485c85784ad5ab0905008129657f', 'request_id': 'req-8f666b9b-562c-46d2-9edc-6ef7be613bbe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.716549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:23.717550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] The token cache is being invalidate because project b10f485c85784ad5ab0905008129657f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:23.717841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.718042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.718518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f666b9b-562c-46d2-9edc-6ef7be613bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:23.720261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 928/1856] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:23 2022] DELETE /identity/v3/projects/b10f485c85784ad5ab0905008129657f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:23.725647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882c8d-d055-40cb-a540-3f24fa151fc1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.725647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882c8d-d055-40cb-a540-3f24fa151fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.725838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e882c8d-d055-40cb-a540-3f24fa151fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.745203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9e882c8d-d055-40cb-a540-3f24fa151fc1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:23.746448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9e882c8d-d055-40cb-a540-3f24fa151fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.793311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 929/1857] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:23.801597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.804129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.813102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 929/1858] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:23.818954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.819245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.819524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.839006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:23.840292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:23.849737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 930/1859] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:23.853755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.863778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8d475-b8d1-4cfe-b7f0-a5b6f6daa737 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.864598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daa08e-5db3-4aae-ac34-13bc957a6cc8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.868591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.869073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.869285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.869494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.869716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.869826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.869998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.870509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.870610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:23.870832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.873367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.880654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.882096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.893531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 930/1860] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:23.897088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 931/1861] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:11:23.899275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.911717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb8f14-5841-4f01-baab-a8966b79b049 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:23.918849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:23.919597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:23.920030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:23.920322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:23.921031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:23.923027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:23.949348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 931/1862] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:23.953636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:23.964088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81dbf-2cc3-4bec-82a1-7ce9cbcb6e4f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.022817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.023491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.023774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.024055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.024725 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.028029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.057321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 932/1863] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:23 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:24.061512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.076188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfa02d-88d2-4afd-ac67-4a40dfbcb751 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.082345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.083027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.083373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.083656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.084392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.086031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.101152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 932/1864] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:24.104877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.116907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc1894-cc41-407f-9315-0ae6e75da092 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.123156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.123913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.124213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.124868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.126334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.129304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.144429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 933/1865] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:24.145494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.156412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.156990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0037-fe8e-4c08-ad98-156ba53d89a8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.159280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.162340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.163263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.163539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.163811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] PATH_INFO: `/v3/projects/8981a724847c4cafa50ab13d2921cc52/users/adcfb69c45364b6686ded091e076a6a9/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.173865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc22cd-0fc0-4927-b4f5-827201371dda admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.179244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.180062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.180347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.180623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] PATH_INFO: `/v3/users/20c4e5d75f694c33950aaeb4354064b2` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.182122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c4e5d75f694c33950aaeb4354064b2)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.183071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8981a724847c4cafa50ab13d2921cc52, user_id=adcfb69c45364b6686ded091e076a6a9, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.184077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.186348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.210111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 933/1866] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:24 2022] PUT /identity/v3/projects/8981a724847c4cafa50ab13d2921cc52/users/adcfb69c45364b6686ded091e076a6a9/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:24.211124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.220058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.239452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c4e5d75f694c33950aaeb4354064b2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.240284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c4e5d75f694c33950aaeb4354064b2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.252645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c4e5d75f694c33950aaeb4354064b2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.260572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c4e5d75f694c33950aaeb4354064b2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.261279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-92dac8a4-e3dd-4987-a3f4-7b15a2ae396e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c4e5d75f694c33950aaeb4354064b2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.273585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 934/1867] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:24 2022] DELETE /identity/v3/users/20c4e5d75f694c33950aaeb4354064b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:24.276467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd516a5-54ca-4bd8-8f3f-c444bc786607 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.276467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd516a5-54ca-4bd8-8f3f-c444bc786607 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.276467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd516a5-54ca-4bd8-8f3f-c444bc786607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.286059 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af7cfa-e443-4a75-b8f1-07d6acef5a9f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.302539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3fd516a5-54ca-4bd8-8f3f-c444bc786607 None None] MFA Rules not processed for user `adcfb69c45364b6686ded091e076a6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:24.303762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3fd516a5-54ca-4bd8-8f3f-c444bc786607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.341630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.342495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.342780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.343058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] PATH_INFO: `/v3/projects/64d3d4f7a6e34697b62d9b6cbe04af52` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.344239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d3d4f7a6e34697b62d9b6cbe04af52)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.346181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.365182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 935/1868] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:24.366550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.366836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.367112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.385098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:24.386208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.397517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d3d4f7a6e34697b62d9b6cbe04af52', 'request_id': 'req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.404675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d3d4f7a6e34697b62d9b6cbe04af52', 'request_id': 'req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.411054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d3d4f7a6e34697b62d9b6cbe04af52', 'request_id': 'req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.420878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] The token cache is being invalidate because project 64d3d4f7a6e34697b62d9b6cbe04af52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:24.421201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.421854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.423410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 934/1869] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:24 2022] DELETE /identity/v3/projects/64d3d4f7a6e34697b62d9b6cbe04af52 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:24.424824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.426163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.448781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 936/1870] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:24.448781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.448781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.467074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4ad8e-66c7-4745-85d1-a92cfc7639c9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.493731 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.494615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.494892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.495163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] PATH_INFO: `/v3/users/17b160b5205e44a0bad8968348a1ae47` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.496617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b160b5205e44a0bad8968348a1ae47)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.499358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.513623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ffb8d-aaf6-45f4-b9ec-fd6a70cafcff admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.521931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.522606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.523162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.523450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.524924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.526078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.553883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b160b5205e44a0bad8968348a1ae47'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.554557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b160b5205e44a0bad8968348a1ae47'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.560521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 935/1871] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:24 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:24.561603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.563302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.571983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b160b5205e44a0bad8968348a1ae47'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.580763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b160b5205e44a0bad8968348a1ae47'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.581604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b160b5205e44a0bad8968348a1ae47'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:24.597480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 937/1872] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:24 2022] DELETE /identity/v3/users/17b160b5205e44a0bad8968348a1ae47 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:24.597480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.597480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.653687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a9a0e-a781-444d-8bb5-2ec8d633773f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.684736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9ce17-1d2b-4372-bd24-2dc57ddce646 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.690120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.690801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.691152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.691430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.692122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.694064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.722307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 938/1873] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:24 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:24.725682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.726042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.726427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.726639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.726920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.728789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.738913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ebd7c-5c7e-41f5-8b06-0aef26887ea4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.744119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.744785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.745092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.745380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.746107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.747688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.747916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.749543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.759450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 939/1874] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:24.760210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 936/1875] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:24.765401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.777205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc96a3-13fa-4f68-b370-ccec51ef0e74 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.782198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.783774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.784056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.784331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] PATH_INFO: `/v3/projects/3aaee2dc568c4189b08667bb326ed0c6/users/9a3e9ed6ce174207be210b60e118bcd0/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.800499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aaee2dc568c4189b08667bb326ed0c6, user_id=9a3e9ed6ce174207be210b60e118bcd0, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.803525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.817307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 940/1876] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:24 2022] PUT /identity/v3/projects/3aaee2dc568c4189b08667bb326ed0c6/users/9a3e9ed6ce174207be210b60e118bcd0/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:24.821621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.832609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe075afe-c04b-4fbe-9c19-0cbd49989d3d service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.902726 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.903771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.904063 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.904334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.905312 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.906873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.922376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.926150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:24.940990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 937/1877] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:24.945561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:24.951115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e79d2c-79f3-435d-bc70-401c59cec2f2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.958037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.959162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.959664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.960037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] PATH_INFO: `/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.961524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b3cda16a2c47e9bc6649a4ca9e142e)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.964963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:24.970928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef9f83-c750-4be3-8649-e19c35a48065 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:24.983767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:24.984917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:24.985468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:24.985883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] PATH_INFO: `/v3/projects/3aaee2dc568c4189b08667bb326ed0c6/users/9a3e9ed6ce174207be210b60e118bcd0/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:24.988833 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aaee2dc568c4189b08667bb326ed0c6, user_id=9a3e9ed6ce174207be210b60e118bcd0, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:24.992728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cf860-9a00-4738-85f3-b352f51c9c83 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.008061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 938/1878] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:24 2022] PUT /identity/v3/projects/3aaee2dc568c4189b08667bb326ed0c6/users/9a3e9ed6ce174207be210b60e118bcd0/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:25.019835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.020123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.020399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.034507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b3cda16a2c47e9bc6649a4ca9e142e', 'request_id': 'req-e0b15990-7c26-4f4b-8724-815738199b4a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.040193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b3cda16a2c47e9bc6649a4ca9e142e', 'request_id': 'req-e0b15990-7c26-4f4b-8724-815738199b4a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.048536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] MFA Rules not processed for user `9a3e9ed6ce174207be210b60e118bcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:25.049828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.050185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b3cda16a2c47e9bc6649a4ca9e142e', 'request_id': 'req-e0b15990-7c26-4f4b-8724-815738199b4a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.063418 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] The token cache is being invalidate because project 02b3cda16a2c47e9bc6649a4ca9e142e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:25.064053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.064491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e0b15990-7c26-4f4b-8724-815738199b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.066159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 941/1879] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:24 2022] DELETE /identity/v3/projects/02b3cda16a2c47e9bc6649a4ca9e142e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:25.070824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03da5-79fe-4ec5-8ca6-aa8547fdac20 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.071113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03da5-79fe-4ec5-8ca6-aa8547fdac20 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.071387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb03da5-79fe-4ec5-8ca6-aa8547fdac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.100540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-afb03da5-79fe-4ec5-8ca6-aa8547fdac20 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:25.101796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-afb03da5-79fe-4ec5-8ca6-aa8547fdac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.145216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 939/1880] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:25.153121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.154990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.175715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 942/1881] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:25.183705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.184074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.184440 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.211070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:25.212720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.223393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 943/1882] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:25.227836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.231985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c02859-74f7-46c6-a810-59014317f292 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.236618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.237544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.238132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.238561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.238672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f432e7a-5913-426b-90dc-8cb2ee93112d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.243515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.244158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.244432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.244709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.245454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:25.245757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.247629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.254626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.257101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.262141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 944/1883] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:25.266832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.278830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec68992-0c19-431c-8e2f-936dfad852ea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.285589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.286233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.286527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.286869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.287561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.289881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.299954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 940/1884] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:25.326008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 945/1885] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:25.327066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.348197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad287e-8f74-4125-9171-96ad59cdb5ac service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.362425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.371897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.455479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.456612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.456612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.456893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.457437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.459628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.488139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bfdd91-343d-4ec8-a2de-4dd351593777 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.496047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 941/1886] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:25.496226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.496323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.496636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.496922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] PATH_INFO: `/v3/projects/cd9f627462404820b7133197d8850ab1` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.498263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9f627462404820b7133197d8850ab1)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.500415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.505805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.524198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d4c9d-9c5b-44f4-8ea4-89454546d448 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.530038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.530908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.531451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.532229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.533194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.535306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.558079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 942/1887] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:25.558777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.576098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42060fd-a2ee-424e-ba16-0457136ce99a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.576412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9f627462404820b7133197d8850ab1', 'request_id': 'req-ef8402b1-4809-4c0b-9210-9e0fe889d96e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.585266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9f627462404820b7133197d8850ab1', 'request_id': 'req-ef8402b1-4809-4c0b-9210-9e0fe889d96e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.596055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9f627462404820b7133197d8850ab1', 'request_id': 'req-ef8402b1-4809-4c0b-9210-9e0fe889d96e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.612891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] The token cache is being invalidate because project cd9f627462404820b7133197d8850ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:25.613794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.615214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.618182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 946/1888] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:25 2022] DELETE /identity/v3/projects/cd9f627462404820b7133197d8850ab1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:25.621855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.623364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.682602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.683116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.683990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.684375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.685514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.688403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6481f9-8767-4c2e-98be-40b626fd5891 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.703001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 943/1889] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:25.709821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.710251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.710626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.712706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 944/1890] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:11:25.713790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:25.716992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.726720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402b1-4809-4c0b-9210-9e0fe889d96e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.734809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.735922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.736344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.736646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] PATH_INFO: `/v3/users/edbe159d50ec4cc7b35b03e590b374eb` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.738027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbe159d50ec4cc7b35b03e590b374eb)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.740071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.745043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d2dd7e-bb74-46f2-9179-98eb26d49819 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:25.764539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:25.766693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.766981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.767923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] PATH_INFO: `/v3/projects/ae57a7847f8b47e38da601afb361bd2b/users/5464138ca6ae4d51ab395dc46e930917/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.825716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae57a7847f8b47e38da601afb361bd2b, user_id=5464138ca6ae4d51ab395dc46e930917, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:25.828973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba45400-5962-4b2a-9174-8bf2529f66bb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:25.840332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbe159d50ec4cc7b35b03e590b374eb'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.841332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbe159d50ec4cc7b35b03e590b374eb'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.851360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 945/1891] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:25 2022] PUT /identity/v3/projects/ae57a7847f8b47e38da601afb361bd2b/users/5464138ca6ae4d51ab395dc46e930917/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:25.865746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbe159d50ec4cc7b35b03e590b374eb'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.874001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.874369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.874555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.878107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbe159d50ec4cc7b35b03e590b374eb'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.879421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-08e57251-89b5-4ae2-9b13-a92d21f4c22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbe159d50ec4cc7b35b03e590b374eb'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:25.899690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 947/1892] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:25 2022] DELETE /identity/v3/users/edbe159d50ec4cc7b35b03e590b374eb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:25.901387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:25.901684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:25.902163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:25.931003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:25.932206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:25.985904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] MFA Rules not processed for user `5464138ca6ae4d51ab395dc46e930917`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:25.989573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.104895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 946/1893] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:26.185951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.188012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.201170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 948/1894] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:26.214141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a519d1-82d1-4e9d-8ff9-5ddc2f5845ba None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.222109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.223153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.223582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.223994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.226814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.232317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.238222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.240611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.259885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 947/1895] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:26.300461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.302171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.349934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8df138-245d-40b0-add3-efb6a3553491 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.359697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.360678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.361016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.363024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.363922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.368476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.383692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da14fa-3b1e-4a4b-9c65-bfa32d7a53e9 service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.389244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.390247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.390621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.390899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] PATH_INFO: `/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.392075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e057ae4ffd6b48d39b8e29d4410f1520)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.394397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.402061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 949/1896] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/projects => generated 393 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:26.402061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.403607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.443870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e057ae4ffd6b48d39b8e29d4410f1520', 'request_id': 'req-a13f9666-a2dc-4cb2-a386-db1f6538cc62'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.457942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e057ae4ffd6b48d39b8e29d4410f1520', 'request_id': 'req-a13f9666-a2dc-4cb2-a386-db1f6538cc62'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.470321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e057ae4ffd6b48d39b8e29d4410f1520', 'request_id': 'req-a13f9666-a2dc-4cb2-a386-db1f6538cc62'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.482845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] The token cache is being invalidate because project e057ae4ffd6b48d39b8e29d4410f1520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:26.483195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.483295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05caa33e-43e1-45f9-959e-7f6d6084dfb5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.483803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.485668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 948/1897] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:26 2022] DELETE /identity/v3/projects/e057ae4ffd6b48d39b8e29d4410f1520 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:26.486868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.488172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.554406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.555968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.557312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.557312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] PATH_INFO: `/v3/users/adcfb69c45364b6686ded091e076a6a9` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.558736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adcfb69c45364b6686ded091e076a6a9)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.558874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f9666-a2dc-4cb2-a386-db1f6538cc62 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.561290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.564765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.565466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.565750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.566019 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.566703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.568727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fdeba-0b14-4721-bc4b-ac5abc1814cc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.596279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 949/1898] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:26.597678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.598127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.598498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.617811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adcfb69c45364b6686ded091e076a6a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.618585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adcfb69c45364b6686ded091e076a6a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.619175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:26.620599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.629318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 950/1899] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:26.631506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adcfb69c45364b6686ded091e076a6a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.635376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.637154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.640658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adcfb69c45364b6686ded091e076a6a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.641470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f08e052-d4ec-4af1-9577-c55c83229085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adcfb69c45364b6686ded091e076a6a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:26.650125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5640-9202-4ddd-96bb-8cd61017bae8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.655339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.656016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.656352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.656639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.657471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.657642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 950/1900] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:26 2022] DELETE /identity/v3/users/adcfb69c45364b6686ded091e076a6a9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:26.659754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.660117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.660382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab988-5cc0-41dc-8853-b87c6f6b4244 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.660938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.674459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 951/1901] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:26.674459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.674459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.674459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.690113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:26.691375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.691522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:26.692685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.748137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 952/1902] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:26.751780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 951/1903] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:26.751899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.752989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.758338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4eda5-a05d-479f-813c-8acad1ad22af None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.762355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24495caa-9a3e-488a-9725-149d80213b09 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.763494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.764368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.764647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.764923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] PATH_INFO: `/v3/projects/211a6f9411bb44888ec34c44f8be2a28/users/f69a4f256d6b421d88b4772e37928ed5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.767153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.768328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.768605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.768878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.769638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:26.769943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.771573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.779651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] RBAC: Authorizing `identity:create_grant(project_id=211a6f9411bb44888ec34c44f8be2a28, user_id=f69a4f256d6b421d88b4772e37928ed5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.782299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.782975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 952/1904] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:26.784360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.787769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:26.797237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 953/1905] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:26 2022] PUT /identity/v3/projects/211a6f9411bb44888ec34c44f8be2a28/users/f69a4f256d6b421d88b4772e37928ed5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:26.798200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.841758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af9557-16aa-421c-9ea8-c24b84c79cbb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.856858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46cbc8-4272-45e7-a2b6-0f54498cf61b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.861582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.862242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.862529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.862804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.864181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.866249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.895265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 954/1906] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:26.896189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.901152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.901796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.902077 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.902350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.912387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.913851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.924241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 953/1907] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:26.924729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.933688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d705c69-9458-4efd-a84d-cf99676c3ce5 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.962425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86858125-fd2c-492e-84a0-5795bb6cd4cd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:26.969086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.969758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.970043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.970333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.971317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:26.972676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:26.985112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 955/1908] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:26.988890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:26.995766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:26.996795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:26.997202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:26.997499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:26.998318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.000045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f34537-b203-4807-ae46-932e499ff8f3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.000414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.005668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.006854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.006854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.007101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] PATH_INFO: `/v3/projects/211a6f9411bb44888ec34c44f8be2a28/users/f69a4f256d6b421d88b4772e37928ed5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.010330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211a6f9411bb44888ec34c44f8be2a28, user_id=f69a4f256d6b421d88b4772e37928ed5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.013117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800c7b8-794f-4c9e-abde-28b5f62eaad9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.022186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 954/1909] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:26 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:27.025548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 956/1910] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:26 2022] PUT /identity/v3/projects/211a6f9411bb44888ec34c44f8be2a28/users/f69a4f256d6b421d88b4772e37928ed5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:27.028201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.036443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.036443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.036763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.040254 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f6971-6518-4a1d-b1a7-5cf705b69513 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.063963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] MFA Rules not processed for user `f69a4f256d6b421d88b4772e37928ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:27.066581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.104954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.105657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.105935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.106206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.106967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.108650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.118760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 955/1911] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:27.122908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.139884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e477d6-4d43-41da-8268-244e081fc680 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.148448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.148998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.149435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.149717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.150444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.152035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.167711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 956/1912] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:27.172539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.179454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 957/1913] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:27.185555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.186956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.187075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a13cd-4bf8-40d9-9180-b2a04d9ecccd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.192702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.193867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.194145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.194417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] PATH_INFO: `/v3/projects/a54b32a58c1c48b19f46bb0b6fccbb86/users/a389282153d64947af31d8d1b072937f/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.211156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54b32a58c1c48b19f46bb0b6fccbb86, user_id=a389282153d64947af31d8d1b072937f, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.214020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d062b4-8af5-46ee-9ec1-fc1496971da0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.235465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 957/1914] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:27 2022] PUT /identity/v3/projects/a54b32a58c1c48b19f46bb0b6fccbb86/users/a389282153d64947af31d8d1b072937f/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:27.249235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.249582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.251190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.258943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd141710-a540-4c0c-a25d-0c29a8f0e241 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.286131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] MFA Rules not processed for user `a389282153d64947af31d8d1b072937f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:27.291847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.325571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.326633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.327137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.327613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.378498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 958/1915] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:27.378498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.380250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.424023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.428070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.448476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 958/1916] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:27.449342 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.484626 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b53e2-85ad-483c-8fef-5df413810fd9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.494045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.494045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.494045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.494045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] PATH_INFO: `/v3/projects/8981a724847c4cafa50ab13d2921cc52` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.494333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8981a724847c4cafa50ab13d2921cc52)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.494711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.535290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b7ef-c934-4f3a-a903-b32c082f29e0 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.543565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8981a724847c4cafa50ab13d2921cc52', 'request_id': 'req-5464dbaa-f096-4489-97d8-d1c9285e02fe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.549807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8981a724847c4cafa50ab13d2921cc52', 'request_id': 'req-5464dbaa-f096-4489-97d8-d1c9285e02fe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.558818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8981a724847c4cafa50ab13d2921cc52', 'request_id': 'req-5464dbaa-f096-4489-97d8-d1c9285e02fe'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.572818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] The token cache is being invalidate because project 8981a724847c4cafa50ab13d2921cc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:27.573140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.573815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.581029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 959/1917] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:27 2022] DELETE /identity/v3/projects/8981a724847c4cafa50ab13d2921cc52 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:27.581029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.581029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.612695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.614562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.614562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.614562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.614793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.616737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.654562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dbaa-f096-4489-97d8-d1c9285e02fe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.654704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 959/1918] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:27 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:27.654704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.654704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.729478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.730230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.730642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.731006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.733638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.761421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4e9f8-6f81-46ad-8546-ed97b82a0088 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.768163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.769515 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.769832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.770106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] PATH_INFO: `/v3/users/9a3e9ed6ce174207be210b60e118bcd0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.771566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3e9ed6ce174207be210b60e118bcd0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.773655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.802580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.804013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.815638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 960/1919] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:27.818276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.819651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.827584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3e9ed6ce174207be210b60e118bcd0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.828275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3e9ed6ce174207be210b60e118bcd0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.833758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeecf46-e716-4444-b408-203d5cc8b71c service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:27.837799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3e9ed6ce174207be210b60e118bcd0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.838436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3e9ed6ce174207be210b60e118bcd0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.839444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:27.840311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:27.840698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:27.841045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:27.842150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:27.843824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:27.848427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3e9ed6ce174207be210b60e118bcd0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:27.875968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 961/1920] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:27 2022] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:27.880237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:27.883140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:27.897684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 960/1921] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:27 2022] DELETE /identity/v3/users/9a3e9ed6ce174207be210b60e118bcd0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:27.911348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c7fc48-4280-46fa-a21d-759bf16c1513 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.003888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.005007 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.005592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.005891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.006811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.008634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.021888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 962/1922] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:28.026224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.037926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a7654-7162-48c3-8ede-b2160a74f9b2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.050543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.051794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.052759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.053337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] PATH_INFO: `/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd/users/bc0cd75e179d4ed4a675932474be9b82/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.086082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e7dd48aac54b87bc3cd63802b59ecd, user_id=bc0cd75e179d4ed4a675932474be9b82, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.089105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.110343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 961/1923] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:28 2022] PUT /identity/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd/users/bc0cd75e179d4ed4a675932474be9b82/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:28.118669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.132694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07c4ca-4a3c-427f-9c2b-4e1b0ecab707 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.205491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.206693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.206974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.207246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.207978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.209704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.217807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.221594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.224174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 963/1924] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:28.234063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.239783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a356b96-a639-43de-8dba-bb834ede44b8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.244315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9625f-8427-446e-bb5c-6af34bb3b86b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.247474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.248316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.248643 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.248917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] PATH_INFO: `/v3/projects/3aaee2dc568c4189b08667bb326ed0c6` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.249763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.250413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aaee2dc568c4189b08667bb326ed0c6)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.251005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.251375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.251790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] PATH_INFO: `/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd/users/bc0cd75e179d4ed4a675932474be9b82/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.252767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.254265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e7dd48aac54b87bc3cd63802b59ecd, user_id=bc0cd75e179d4ed4a675932474be9b82, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.256921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e6e2d-2d4c-434e-8698-1e3a651af9e7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.276333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 964/1925] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:28 2022] PUT /identity/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd/users/bc0cd75e179d4ed4a675932474be9b82/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:28.288454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.288778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.289217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.311465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aaee2dc568c4189b08667bb326ed0c6', 'request_id': 'req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.321682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aaee2dc568c4189b08667bb326ed0c6', 'request_id': 'req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.325179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] MFA Rules not processed for user `bc0cd75e179d4ed4a675932474be9b82`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:28.326718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.328728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aaee2dc568c4189b08667bb326ed0c6', 'request_id': 'req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.341772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] The token cache is being invalidate because project 3aaee2dc568c4189b08667bb326ed0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:28.342238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.343005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7d9f9b62-5e82-48cb-8b3e-e602fd9fd75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.348730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 962/1926] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:28 2022] DELETE /identity/v3/projects/3aaee2dc568c4189b08667bb326ed0c6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:28.352760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889a87-3e09-49d1-857d-58577e0dd56b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.353075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889a87-3e09-49d1-857d-58577e0dd56b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.353509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d889a87-3e09-49d1-857d-58577e0dd56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.377349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5d889a87-3e09-49d1-857d-58577e0dd56b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:28.378749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5d889a87-3e09-49d1-857d-58577e0dd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.437795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 965/1927] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:28.448076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 963/1928] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:28.448808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.455788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.459263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.460226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.460911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.485913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:28.487185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.499665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 964/1929] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:28.500579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.531898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e41ac-dcfa-49f8-8134-234d83c78e61 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.537973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.538884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.539182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.539592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.540453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:28.540753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.542423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.556662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 965/1930] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:28.561551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.568273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946ddb-2d90-4b78-9737-9ff355e14c3c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.572645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.573004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.573526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.573730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.578145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eeab09-4e77-4c3b-8015-027e359831cf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.585974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.587254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.587436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.587885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.588337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.589257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.589622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.591875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.602631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 966/1931] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:28.634676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 966/1932] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:28.638836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.651617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c1688-02df-48ea-8e24-6183901c1e90 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.705818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.739184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.740398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.740684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.740959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.742428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.745008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.774225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da832a-4445-4cd2-b398-6d5d429d1ad8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.775469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 967/1933] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:28.776539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.778467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.782104 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.783000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.783293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.783568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.786300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.792409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b4999-4b3d-46d8-ba63-b610e3e0e516 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.798914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.800097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.800547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.800964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] PATH_INFO: `/v3/users/a389282153d64947af31d8d1b072937f` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.802476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a389282153d64947af31d8d1b072937f)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.804527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.857948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a389282153d64947af31d8d1b072937f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.858612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a389282153d64947af31d8d1b072937f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.858747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.860149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.871268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 967/1934] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:28.872323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.882730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a389282153d64947af31d8d1b072937f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.884625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052e66-7462-4f91-bcf9-86dd6fe9665f service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:28.891608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:28.892145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.892480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.892826 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.893020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a389282153d64947af31d8d1b072937f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.893645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a389282153d64947af31d8d1b072937f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:28.893923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:28.895782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865dac8-4c61-4eff-885f-b5ad81c1f15c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:28.909152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 968/1936] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:28 2022] DELETE /identity/v3/users/a389282153d64947af31d8d1b072937f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:28.911196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 968/1936] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:28.913328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:28.914185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:28.914575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:28.915042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:28.915747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:28.942209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:28.943126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:29.021393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2e77a-2b65-40e8-9dc0-e854a772d6e8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.027133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.027799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.028082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.028411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.029236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.030915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:29.045134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 969/1937] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:29.046714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:29.047566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 969/1938] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:29.060023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:29.066086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:29.071231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419bebf-90d0-4cf5-a36a-cb2a95c0ea4c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.081472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.085923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.086380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.086660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] PATH_INFO: `/v3/projects/e4c858e99739411b8b417afe681ffe2a/users/0aaa7091f48849a9bc1541c7b9504958/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.127974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c858e99739411b8b417afe681ffe2a, user_id=0aaa7091f48849a9bc1541c7b9504958, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.130808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a32b4-343a-46dd-90b3-307eb9131bd4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:29.153096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 970/1939] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:29 2022] PUT /identity/v3/projects/e4c858e99739411b8b417afe681ffe2a/users/0aaa7091f48849a9bc1541c7b9504958/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:29.158935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.159223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.159597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.164467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61665f-a96a-4c1a-9e8c-86a2f1e5c59c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.189981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:29.191504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:29.257902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.258448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.258732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.259003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.313437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 971/1940] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:29.320807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:29.322194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:29.335857 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abc200-c2cb-4292-9d14-3c952dca0a39 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.346889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.348013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.349397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.349696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.355999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.358208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:29.369672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.371613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:29.374218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 970/1941] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:29.383754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 972/1942] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:29.724451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:29.726129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:29.742401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddfb6-8548-453d-b02d-f2a3d65a2816 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.753823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.754780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.755103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.755381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] PATH_INFO: `/v3/projects/a54b32a58c1c48b19f46bb0b6fccbb86` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.757593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54b32a58c1c48b19f46bb0b6fccbb86)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.759873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:29.832973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54b32a58c1c48b19f46bb0b6fccbb86', 'request_id': 'req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:29.842242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54b32a58c1c48b19f46bb0b6fccbb86', 'request_id': 'req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:29.849520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54b32a58c1c48b19f46bb0b6fccbb86', 'request_id': 'req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:29.860042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] The token cache is being invalidate because project a54b32a58c1c48b19f46bb0b6fccbb86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:29.860402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:29.861893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:29.864135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 971/1943] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:29 2022] DELETE /identity/v3/projects/a54b32a58c1c48b19f46bb0b6fccbb86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:29.869790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:29.882920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387ce9-3fe0-441d-b157-3021e52f1959 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:29.954098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:29.955801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:29.956088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:29.956366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] PATH_INFO: `/v3/users/bc0cd75e179d4ed4a675932474be9b82` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:29.957870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0cd75e179d4ed4a675932474be9b82)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:29.959816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.047724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0cd75e179d4ed4a675932474be9b82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.048839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0cd75e179d4ed4a675932474be9b82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.069980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0cd75e179d4ed4a675932474be9b82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.087896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0cd75e179d4ed4a675932474be9b82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.089396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-16847af5-9764-4364-8146-a53e8a5e6342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0cd75e179d4ed4a675932474be9b82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.103916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 973/1944] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:29 2022] DELETE /identity/v3/users/bc0cd75e179d4ed4a675932474be9b82 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:30.393224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.394830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.434177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc0aa-5170-4e2f-a0f0-e9d3b78b117e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.489673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.490195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.490281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.523892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] MFA Rules not processed for user `0aaa7091f48849a9bc1541c7b9504958`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:30.525836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.531285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.533255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.533800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.534206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] PATH_INFO: `/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.535563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e7dd48aac54b87bc3cd63802b59ecd)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.537632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.600785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e7dd48aac54b87bc3cd63802b59ecd', 'request_id': 'req-18ad0f02-9834-4c66-b437-a73965ea9caa'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.614256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 974/1945] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:30.624572 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.627409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e7dd48aac54b87bc3cd63802b59ecd', 'request_id': 'req-18ad0f02-9834-4c66-b437-a73965ea9caa'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.629387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.636340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e7dd48aac54b87bc3cd63802b59ecd', 'request_id': 'req-18ad0f02-9834-4c66-b437-a73965ea9caa'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.648020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] The token cache is being invalidate because project d3e7dd48aac54b87bc3cd63802b59ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:30.648314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.648982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-18ad0f02-9834-4c66-b437-a73965ea9caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:30.649797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e076-45da-4462-8a1d-708388cac5b3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.653102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 972/1946] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:30 2022] DELETE /identity/v3/projects/d3e7dd48aac54b87bc3cd63802b59ecd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:30.655772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0eda-c9b9-47e9-9d86-eb30a69abfbd None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.656081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0eda-c9b9-47e9-9d86-eb30a69abfbd None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.656359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b0eda-c9b9-47e9-9d86-eb30a69abfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.686236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c24b0eda-c9b9-47e9-9d86-eb30a69abfbd None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:30.687847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c24b0eda-c9b9-47e9-9d86-eb30a69abfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.729830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.730974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.731811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.732312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.733082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.735043 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.760886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 975/1947] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:30.763056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 973/1948] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:30.764748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.766414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.770350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.770638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.770918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.788744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:30.789883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:30.827470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1fb51-8510-41c0-a4dd-08f9e123937d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.832199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.832866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.833202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.833482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.834214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.836105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.851965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 974/1949] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:30.856088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.859211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 976/1950] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:30.860353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.865848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058ca32-dea6-4e44-a63a-db0720ad505f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.870225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d206e4-47af-4009-8fb6-fd07f9570c73 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.870612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.871262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.871545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.871823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.872568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:30.872875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.874491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.874939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.875563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.876100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.876371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.877126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.878675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.889686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 975/1951] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:11:30.889856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 977/1952] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:30.890762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.892382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.900749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508ca72-350b-4ca5-a9e5-725f29c212a1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.902829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4b25-25bb-44fb-8e84-abb1bd377b90 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:30.905410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.906043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.906344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.906598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.907273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.908206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:30.909198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:30.909480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:30.909734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.909841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] PATH_INFO: `/v3/projects/e8f5b42d9d3644ad9730942807e3d551/users/d44e1c5c9b9c4bed94da4ec05d83c8b3/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:30.924656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f5b42d9d3644ad9730942807e3d551, user_id=d44e1c5c9b9c4bed94da4ec05d83c8b3, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:30.927537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:30.935588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 976/1953] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:30.939617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.943588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 978/1954] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:30 2022] PUT /identity/v3/projects/e8f5b42d9d3644ad9730942807e3d551/users/d44e1c5c9b9c4bed94da4ec05d83c8b3/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:30.947307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:30.999056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ada06-3c54-4dab-9efb-938fbf74ff62 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.004129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.004790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.005100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.005382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.006064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.006348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e0266-469f-4893-9975-e3fe27b73e4f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.007960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.011063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.011703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.011977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.012245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.013026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.014608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.025584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 979/1955] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:31.028538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 977/1956] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:30 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:31.029838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.032087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.040281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633381d7-91d0-44a5-964f-8113d0c29bc8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.042116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c98877-4f4c-4381-bbec-44aefc1e2868 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.044872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.045759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.046042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.046316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] PATH_INFO: `/v3/projects/e8f5b42d9d3644ad9730942807e3d551/users/d44e1c5c9b9c4bed94da4ec05d83c8b3/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.046736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.047367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.047645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.047915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.048305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f5b42d9d3644ad9730942807e3d551, user_id=d44e1c5c9b9c4bed94da4ec05d83c8b3, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.048641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.050239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.050893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.061093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 978/1957] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:31.061239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 980/1958] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:31 2022] PUT /identity/v3/projects/e8f5b42d9d3644ad9730942807e3d551/users/d44e1c5c9b9c4bed94da4ec05d83c8b3/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:31.063663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.073418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033ae79-f437-4776-8601-70fe2eca3849 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.130106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.130786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.131073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.131349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.132082 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.133702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0151-35f0-4d95-9b8a-1c47a43782c0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.144487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 979/1959] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:31.148777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.159858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a0ec7-d364-4f47-af2e-aee26973cd99 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.165367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.166266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.166557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.166901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] PATH_INFO: `/v3/projects/e79f6c7b89de45d2a71fdec4d9530207/users/b20aa086236a472092b322b292121b67/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.181923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79f6c7b89de45d2a71fdec4d9530207, user_id=b20aa086236a472092b322b292121b67, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.184539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.198152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 981/1960] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:31 2022] PUT /identity/v3/projects/e79f6c7b89de45d2a71fdec4d9530207/users/b20aa086236a472092b322b292121b67/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:31.209335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.209633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.209916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.240084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] MFA Rules not processed for user `b20aa086236a472092b322b292121b67`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:31.241373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:31.308578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 980/1961] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:31.312794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.378794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ac9cb-09bc-435e-96da-8f1190556dac admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.382865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.383582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.383912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.384273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.384871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.386851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.431959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 982/1962] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:31 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:31.437148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.450864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb170bb8-c54e-49e0-b377-f62c5719224d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.527570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.528249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.528583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.528866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.529603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.531598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.553676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 981/1963] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:31 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:31.555897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.566995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50eab7-9811-4f24-8224-2f88c08ad746 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.572080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.572947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.573271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.573547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.574274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.575883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.587495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 983/1964] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:31.591737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.602376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca116e6-4cc6-4917-afd1-266e6470edd6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.606998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.607881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.608162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.608436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] PATH_INFO: `/v3/projects/ae283fdbc0134edc9766a1f8c37de517/users/6f69dd70d96f48e8b93953629f70d0a7/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.625892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae283fdbc0134edc9766a1f8c37de517, user_id=6f69dd70d96f48e8b93953629f70d0a7, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.628529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.642922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 982/1965] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:31 2022] PUT /identity/v3/projects/ae283fdbc0134edc9766a1f8c37de517/users/6f69dd70d96f48e8b93953629f70d0a7/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:31.647386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.658553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91d63d-e83e-46f4-b9c0-be57a6bc989a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.716052 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.716713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.716988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.717305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.718027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.719615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b115ea-0435-4a36-8abe-29c8789f39b3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.731465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 984/1966] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:31.735838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.746522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c65f0-c38a-492c-abd2-e4c7b20c0493 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:31.751433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:31.752352 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.752630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.752902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] PATH_INFO: `/v3/projects/ae283fdbc0134edc9766a1f8c37de517/users/6f69dd70d96f48e8b93953629f70d0a7/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.754969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae283fdbc0134edc9766a1f8c37de517, user_id=6f69dd70d96f48e8b93953629f70d0a7, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:31.757480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:31.768124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 983/1967] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:31 2022] PUT /identity/v3/projects/ae283fdbc0134edc9766a1f8c37de517/users/6f69dd70d96f48e8b93953629f70d0a7/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:31.779338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a182-c51c-4c69-a08b-332a426201b4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.779578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a182-c51c-4c69-a08b-332a426201b4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.779853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a182-c51c-4c69-a08b-332a426201b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:31.825794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-0338a182-c51c-4c69-a08b-332a426201b4 None None] MFA Rules not processed for user `6f69dd70d96f48e8b93953629f70d0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:31.827034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0338a182-c51c-4c69-a08b-332a426201b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:31.903194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 985/1968] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:31.913811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:31.915482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:31.966557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:31.967155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:31.967845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:32.005275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5b48f-d578-40fb-8b8a-423dfc03df0b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:32.010562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:32.011751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] MFA Rules not processed for user `d44e1c5c9b9c4bed94da4ec05d83c8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:32.011872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:32.012166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:32.012853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:32.013177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:32.025495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:32.027368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:32.051279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 984/1969] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:32.100823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 986/1970] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:32.111094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:32.119854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b338-145d-48f8-8790-568450372284 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:32.126119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:32.128388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:32.129465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:32.132632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:32.134747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:32.148329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:32.150184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:32.161401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f160e0-11c7-49c6-b309-0df4b756531f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:32.165139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:32.165791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:32.166071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:32.166329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:32.195239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:32.196724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:32.206207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 985/1971] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:32.226089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:32.227515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:32.236190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 987/1972] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:35.686965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:35.698896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409d197-b3c9-44f2-947c-086735b0bf6a service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:35.705190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:35.706718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:35.707024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:35.708474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:35.720158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:35.722792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf39e7b-ee4b-4c9a-be5d-be992ec9864d service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:35.762140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 986/1973] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:36.861268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:36.863561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:36.983823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a6f3b-051d-4e9b-8be4-befd2736aa0f service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:36.989607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:36.990684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:36.990997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:36.991262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] PATH_INFO: `/v3/users/5464138ca6ae4d51ab395dc46e930917` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:36.992457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5464138ca6ae4d51ab395dc46e930917)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:36.995255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:37.079777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5464138ca6ae4d51ab395dc46e930917'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:37.080840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5464138ca6ae4d51ab395dc46e930917'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:37.116553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5464138ca6ae4d51ab395dc46e930917'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:37.139891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5464138ca6ae4d51ab395dc46e930917'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:37.140618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5464138ca6ae4d51ab395dc46e930917'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:37.163193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 988/1974] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:36 2022] DELETE /identity/v3/users/5464138ca6ae4d51ab395dc46e930917 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:37.164807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:37.165262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:37.165532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:37.197752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:37.202661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:37.346736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 987/1975] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:37.353549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:37.355166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:37.442193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20494ca0-74ce-437c-a2af-8160432fe034 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:37.447614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:37.448562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:37.449937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:37.449937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:37.462577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:37.464322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:37.480113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 989/1976] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:38.310325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:38.313328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:38.340260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df655a-9921-4361-b5c2-a22aa7ae6fd7 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:38.350114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:38.354953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:38.355432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:38.361089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] PATH_INFO: `/v3/projects/ae57a7847f8b47e38da601afb361bd2b` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:38.371293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae57a7847f8b47e38da601afb361bd2b)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:38.378483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:38.473565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae57a7847f8b47e38da601afb361bd2b', 'request_id': 'req-e053e860-1657-4d26-b1b7-afdbb27a5e60'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.496597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae57a7847f8b47e38da601afb361bd2b', 'request_id': 'req-e053e860-1657-4d26-b1b7-afdbb27a5e60'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.506547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae57a7847f8b47e38da601afb361bd2b', 'request_id': 'req-e053e860-1657-4d26-b1b7-afdbb27a5e60'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.520257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] The token cache is being invalidate because project ae57a7847f8b47e38da601afb361bd2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:38.520602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.521393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.523303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 988/1977] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:38 2022] DELETE /identity/v3/projects/ae57a7847f8b47e38da601afb361bd2b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:38.527202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:38.539789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c91df-8640-46b6-ab20-14c9ee1d0fef service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:38.654651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:38.655601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:38.655977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:38.656301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] PATH_INFO: `/v3/users/f69a4f256d6b421d88b4772e37928ed5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:38.658232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69a4f256d6b421d88b4772e37928ed5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:38.661815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:38.754282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69a4f256d6b421d88b4772e37928ed5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.755237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69a4f256d6b421d88b4772e37928ed5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.790296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69a4f256d6b421d88b4772e37928ed5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.819545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69a4f256d6b421d88b4772e37928ed5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.819545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5f2f3ea3-0cfa-4002-85c5-61740d7f0bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69a4f256d6b421d88b4772e37928ed5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:38.845405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 990/1978] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:38 2022] DELETE /identity/v3/users/f69a4f256d6b421d88b4772e37928ed5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:39.316704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.318258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:39.339066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053e860-1657-4d26-b1b7-afdbb27a5e60 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.457829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.459530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.459968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.460251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] PATH_INFO: `/v3/projects/211a6f9411bb44888ec34c44f8be2a28` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.461629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=211a6f9411bb44888ec34c44f8be2a28)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.463799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.516629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211a6f9411bb44888ec34c44f8be2a28', 'request_id': 'req-90a85791-6fd2-4943-b7cc-37583856fbc7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:39.526928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211a6f9411bb44888ec34c44f8be2a28', 'request_id': 'req-90a85791-6fd2-4943-b7cc-37583856fbc7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:39.535024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211a6f9411bb44888ec34c44f8be2a28', 'request_id': 'req-90a85791-6fd2-4943-b7cc-37583856fbc7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:39.549166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] The token cache is being invalidate because project 211a6f9411bb44888ec34c44f8be2a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:39.549447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:39.550152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-90a85791-6fd2-4943-b7cc-37583856fbc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:39.551725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 989/1979] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:39 2022] DELETE /identity/v3/projects/211a6f9411bb44888ec34c44f8be2a28 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:39.558612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.559177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.559177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.579351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:39.581293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:39.658167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 991/1980] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:39.667498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.667790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.668073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.693455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:39.694879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:39.705012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 990/1981] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:39.709708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.720562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326cb6c-2dd5-4283-85d6-f8cba147483e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.730981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.732369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.733008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.733650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.734739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:39.735712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.738333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.763875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 992/1982] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:11:39.764974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.774483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0ca27-90ff-4619-b396-bf8feda9f8cb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.779445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.780102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.780383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.780655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.781400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.783820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.812362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 991/1983] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:39 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:39.816180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.826496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e02b46-8280-412f-938f-dee3670e1a7f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.882270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.882923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.883201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.883472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.884151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.886152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.904464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 993/1984] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:39 2022] POST /identity/v3/users => generated 280 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:39.909356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.919358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3322-fd0c-4fc5-9fe0-3661a4aa4a7f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.924655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.925340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.925623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.925895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.926614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.928182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.938461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 992/1985] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:39.942565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.954773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b224-2699-47f9-aa8f-b462f2879624 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.959729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.960385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.960664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.960938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:39.961688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:39.963261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288a64-db6d-4f06-82f0-12785a5304b2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:39.973716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 994/1986] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:39.978381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:39.989450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52867bdb-71a7-468a-a29c-ff1420d3d596 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:39.994728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:39.995611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:39.995895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:39.996169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] PATH_INFO: `/v3/projects/d6404445ff7e43ff92a23635e4433674/users/807214aa782e431a9766cc46497fe9dd/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.012076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6404445ff7e43ff92a23635e4433674, user_id=807214aa782e431a9766cc46497fe9dd, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:40.014728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:40.028016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 993/1987] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:39 2022] PUT /identity/v3/projects/d6404445ff7e43ff92a23635e4433674/users/807214aa782e431a9766cc46497fe9dd/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:40.038837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.039126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.039401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.064661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] MFA Rules not processed for user `807214aa782e431a9766cc46497fe9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:40.065945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:40.136614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 995/1988] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:40.163164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:40.164913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:40.221219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7694-6882-45ef-8163-b4b1ddc4f814 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:40.225437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:40.226113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.226396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.226699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.237404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:40.238824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb078cd5-5a9e-4f24-8e80-23b656ccc1eb service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:40.247561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 994/1989] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:40.261932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:40.324001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8993dd7-6b11-4917-8fba-70800e54452f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:40.329556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:40.330927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.331202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.331472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] PATH_INFO: `/v3/users/807214aa782e431a9766cc46497fe9dd` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.332672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807214aa782e431a9766cc46497fe9dd)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:40.334612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:40.381646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807214aa782e431a9766cc46497fe9dd'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.382438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807214aa782e431a9766cc46497fe9dd'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.394269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807214aa782e431a9766cc46497fe9dd'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.401369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807214aa782e431a9766cc46497fe9dd'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.402001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807214aa782e431a9766cc46497fe9dd'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.413683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 996/1990] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:40 2022] DELETE /identity/v3/users/807214aa782e431a9766cc46497fe9dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:40.418228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.418759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.418857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.435347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:40.436525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:40.501210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 995/1991] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:40.511014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:40.512521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:40.567489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26b687-a1d3-4457-b8b9-a441a1927506 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:40.571281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:40.571925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.572197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.572468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.582341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:40.583751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cd782-70a9-4a80-ab2d-bd6ba7a6a224 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:40.593473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 997/1992] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:11:40.860873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:40.862338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:40.882077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b74e13-5dcf-49cb-b0fe-3ba00943c64d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:40.887873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:40.888823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.888978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.889293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] PATH_INFO: `/v3/projects/d6404445ff7e43ff92a23635e4433674` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:40.891266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6404445ff7e43ff92a23635e4433674)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:40.893840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:40.941353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6404445ff7e43ff92a23635e4433674', 'request_id': 'req-275d524c-e168-4c09-9979-d9f40fe34746'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.950321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6404445ff7e43ff92a23635e4433674', 'request_id': 'req-275d524c-e168-4c09-9979-d9f40fe34746'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.957215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6404445ff7e43ff92a23635e4433674', 'request_id': 'req-275d524c-e168-4c09-9979-d9f40fe34746'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.968389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] The token cache is being invalidate because project d6404445ff7e43ff92a23635e4433674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:40.968682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.969359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-275d524c-e168-4c09-9979-d9f40fe34746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:40.975246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 996/1993] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:40 2022] DELETE /identity/v3/projects/d6404445ff7e43ff92a23635e4433674 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:40.977015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:40.977344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:40.977619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.003557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:41.004888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:41.061193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 998/1994] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:41.070128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.070416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.070694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.088529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:41.089753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:41.098128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 997/1995] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:41.102337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.112203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8ad7a-2e84-4aed-bdb4-0a3fcc62a554 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.116838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.117503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.117778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.118046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.118752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:41.119131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.120607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.132468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 999/1996] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:41.137099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.146285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fca3af-837e-41d3-8323-c665833c77e1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.150942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.151581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.151861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.152133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.152812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.154739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.179714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 998/1997] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:41.183974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.193691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e00e9-0109-4399-afe7-fe14cd26a479 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.246962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.247617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.247918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.248149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.248817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.250983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.270450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1000/1998] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:41.274530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.286275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c855f-acf9-4a29-9497-b0d682f386e2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.291085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.291749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.292023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.292299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.293035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.294987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.306461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 999/1999] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:41.310462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.320831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eb563-130b-4575-ae46-66d96896ee33 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.325567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.326223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.326499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.326770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.327489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.329039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5573a91-e97c-4318-809e-74437001c1fe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.339035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1001/2000] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:41.343098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.353310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833fc29-dd69-46d4-82bd-71ac19e3f83d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.357898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.358883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.359535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.359816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] PATH_INFO: `/v3/projects/676fe9f8d9bb4fd3819754d21171394a/users/fdabfed36fb642d89177ef3d4d789022/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.378252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676fe9f8d9bb4fd3819754d21171394a, user_id=fdabfed36fb642d89177ef3d4d789022, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.381329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.394324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1000/2001] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:41 2022] PUT /identity/v3/projects/676fe9f8d9bb4fd3819754d21171394a/users/fdabfed36fb642d89177ef3d4d789022/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:41.405235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.405528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.405806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.433615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] MFA Rules not processed for user `fdabfed36fb642d89177ef3d4d789022`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:41.434798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:41.498848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1002/2002] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:41.504196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.563800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb4cd-3a50-48a9-b0fb-2e93e5262f58 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.568980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.569659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.569940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.570221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.570910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.572791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.597138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1001/2003] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:41.601240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.612387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5deb9-1ca0-4036-a121-5ef9b154e02b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.665872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.666521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.666798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.667070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.667754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.669673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.689385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1003/2004] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:41.693236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.703040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f2230-5636-475f-9633-e43200aff2a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.708220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.708865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.709177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.709450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.710160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.711713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.722386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1002/2005] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:41.725992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.735559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b709a4-d75a-4ead-9b62-0e9fc86f5d0f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.740125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.740757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.741033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.741336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.742045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.743624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c434e6-6fee-4529-874b-1a6fe6c4296a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.753384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1004/2006] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:41.757829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.767191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2743ba-3666-46f5-a9dc-b9d8a714c587 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.772610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.773503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.773777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.774041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] PATH_INFO: `/v3/projects/caa99ee074974189925aeca383b51651/users/c6e65b4ba0804a69bc0757148942bb7f/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.788396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa99ee074974189925aeca383b51651, user_id=c6e65b4ba0804a69bc0757148942bb7f, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.790996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:41.804645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1003/2007] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:41 2022] PUT /identity/v3/projects/caa99ee074974189925aeca383b51651/users/c6e65b4ba0804a69bc0757148942bb7f/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:41.814651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.814831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.815104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.844872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] MFA Rules not processed for user `c6e65b4ba0804a69bc0757148942bb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:41.846778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:41.909035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1005/2008] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:41.913484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:41.971854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d9e0-2d8f-4a38-8995-3670532275b7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:41.976476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:41.977148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:41.977435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:41.977710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:41.978386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:41.980262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.005012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1004/2009] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:41 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:42.008635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.019172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e64b13-88bb-4bee-a0df-00c90ec7f9a0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.072893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.074897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.074897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.074897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.074897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.076760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.103264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1006/2010] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:42 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:42.107206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.122716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47249de-beb9-45c5-8d16-0af444f6438a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.127796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.128473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.128756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.129176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.129790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.131367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.142080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1005/2011] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:42.146192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.155800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c4534-7d81-4d86-9cc6-5e789f5f7946 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.165115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.166073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.166355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.166655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] PATH_INFO: `/v3/projects/de9dd1b090b243e18dc6183b21c3b265/users/e9726614d8bd4bf0bc6d80d25e1b065b/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.182139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9dd1b090b243e18dc6183b21c3b265, user_id=e9726614d8bd4bf0bc6d80d25e1b065b, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.184757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.197131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1007/2012] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:42 2022] PUT /identity/v3/projects/de9dd1b090b243e18dc6183b21c3b265/users/e9726614d8bd4bf0bc6d80d25e1b065b/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:42.201048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.211291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a26584-5474-44a5-85e1-39133ce23052 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.264701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.265322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.265608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.265884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.266599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.268243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d6d37-c585-4ebc-a9f2-5a1ffc0373b6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.277613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1006/2013] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:42.281608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.291751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce077a-2e8f-47d7-be93-6706351bf614 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.296522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.297466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.297749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.298025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] PATH_INFO: `/v3/projects/de9dd1b090b243e18dc6183b21c3b265/users/e9726614d8bd4bf0bc6d80d25e1b065b/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.300514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9dd1b090b243e18dc6183b21c3b265, user_id=e9726614d8bd4bf0bc6d80d25e1b065b, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.303129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.313099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1008/2014] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:42 2022] PUT /identity/v3/projects/de9dd1b090b243e18dc6183b21c3b265/users/e9726614d8bd4bf0bc6d80d25e1b065b/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:42.324943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.325263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.325541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.354226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] MFA Rules not processed for user `e9726614d8bd4bf0bc6d80d25e1b065b`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:42.355447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:42.423542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1007/2015] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:42.434061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:42.435755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:42.490606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dedc1-1171-43f8-a03e-faae03bebddd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:42.494305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:42.494946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:42.495226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:42.495557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:42.552222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:42.553720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:42.562663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1009/2016] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:46.200589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:46.201488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:46.212904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8ef1b-03f6-4ff3-816d-c5e26ab67236 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:46.217429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:46.218075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:46.218443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:46.218633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:46.272458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:46.274784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:46.295872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:46.297358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5ffa0-1701-4d21-886f-637eb64d5fc5 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:46.306917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1008/2017] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:46.347913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d33d8-2168-472d-8242-7863a960c0c4 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:46.353032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:46.353941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:46.354216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:46.354484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] PATH_INFO: `/v3/users/b20aa086236a472092b322b292121b67` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:46.355807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20aa086236a472092b322b292121b67)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:46.357820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:46.421566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20aa086236a472092b322b292121b67'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:46.422221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20aa086236a472092b322b292121b67'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:46.438121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20aa086236a472092b322b292121b67'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:46.449997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20aa086236a472092b322b292121b67'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:46.450726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20aa086236a472092b322b292121b67'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:46.474209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1010/2018] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:46 2022] DELETE /identity/v3/users/b20aa086236a472092b322b292121b67 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:46.478736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:46.479246 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:46.479511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:46.508770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:46.510200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:46.589756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1009/2019] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:46.602081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:46.603588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:46.683751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c838df-c58b-4083-a2a7-e1bf070a2b34 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:46.688779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:46.690198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:46.690576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:46.690850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:46.701639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:46.704447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:46.718119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1011/2020] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:47.052655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:47.054362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:47.072348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:47.073904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:47.099859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe617c-045e-4685-aeaa-bf27bbce69be service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:47.110015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:47.111039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:47.111453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:47.111794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] PATH_INFO: `/v3/projects/e79f6c7b89de45d2a71fdec4d9530207` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:47.114492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79f6c7b89de45d2a71fdec4d9530207)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:47.116552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:47.174599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf3d3e-9b22-4c39-b161-9474d4d2457e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:47.186667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79f6c7b89de45d2a71fdec4d9530207', 'request_id': 'req-36f37d79-fb56-44ea-803b-b770f5ef28db'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.194884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79f6c7b89de45d2a71fdec4d9530207', 'request_id': 'req-36f37d79-fb56-44ea-803b-b770f5ef28db'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.206534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79f6c7b89de45d2a71fdec4d9530207', 'request_id': 'req-36f37d79-fb56-44ea-803b-b770f5ef28db'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.218328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] The token cache is being invalidate because project e79f6c7b89de45d2a71fdec4d9530207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:47.218684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.219385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.221859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1012/2021] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:47 2022] DELETE /identity/v3/projects/e79f6c7b89de45d2a71fdec4d9530207 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:47.225845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:47.227204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:47.228069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:47.228848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:47.229248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:47.229518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:47.231432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:47.304793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:47.308013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:47.310633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f37d79-fb56-44ea-803b-b770f5ef28db admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:47.319238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:47.320581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:47.321116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:47.321485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] PATH_INFO: `/v3/users/6f69dd70d96f48e8b93953629f70d0a7` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:47.321879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1010/2022] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:47.322788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f69dd70d96f48e8b93953629f70d0a7)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:47.324842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:47.386108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f69dd70d96f48e8b93953629f70d0a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.386794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f69dd70d96f48e8b93953629f70d0a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.399714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f69dd70d96f48e8b93953629f70d0a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.408833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f69dd70d96f48e8b93953629f70d0a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.409490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-110f9782-6a62-4b0a-b53d-23eac62c1161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f69dd70d96f48e8b93953629f70d0a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.426612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1013/2023] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:47 2022] DELETE /identity/v3/users/6f69dd70d96f48e8b93953629f70d0a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:47.746081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:47.771565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee768a43-e78a-408a-8b6f-05d7a390973f service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:47.836038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:47.836908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:47.837219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:47.837497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] PATH_INFO: `/v3/projects/ae283fdbc0134edc9766a1f8c37de517` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:47.838686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae283fdbc0134edc9766a1f8c37de517)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:47.840577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:47.886766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae283fdbc0134edc9766a1f8c37de517', 'request_id': 'req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.894778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae283fdbc0134edc9766a1f8c37de517', 'request_id': 'req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.900996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae283fdbc0134edc9766a1f8c37de517', 'request_id': 'req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.911637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] The token cache is being invalidate because project ae283fdbc0134edc9766a1f8c37de517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:47.911921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.912598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-0cf71623-23a1-4cbc-8f5d-89250ce8b07c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:47.914188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1011/2024] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:47 2022] DELETE /identity/v3/projects/ae283fdbc0134edc9766a1f8c37de517 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:47.919062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:47.919370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:47.919630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:47.936890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:47.938106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:47.994276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1014/2025] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:48.004965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.005280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.007563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.026372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:48.027576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:48.035512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1012/2026] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:48.039867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.049425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c46520-19a1-47f6-b0b3-d3505d650b42 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.054059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.054705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.054988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.055261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.055979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:48.056281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.057887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.069761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1015/2027] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:48.074053 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.083842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e5199-f499-451e-a43e-69294e0ed34b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.094581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.095258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.096090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.096371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.097105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.099064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.134922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1013/2028] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:48 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:48.136055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.147157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400f78a-89ac-4853-83bb-19dfd6b42586 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.201554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.202218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.202500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.202768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.203446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.205406 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.227411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1016/2029] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:48 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:48.228688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.241903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087e645-084a-4320-b66a-ccc97e3f3714 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.246823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.247486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.247772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.248049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.248777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.250405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.261426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1014/2030] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:48.265287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.275546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c82bba-b6ed-4b93-86cf-fda07e124d05 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.280149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.280795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.281090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.281364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.282078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.284273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219209a-babb-4c0d-9eab-500347b7f91b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.294161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1017/2031] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:48.298316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.308069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c5144-2478-47e8-870e-292d6a7d305d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.312683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.313578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.313853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.314133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] PATH_INFO: `/v3/projects/115ce5f41c0141dba0517bf9ba1bbec7/users/2041ef1ae732471b9bd071cfd4768937/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.328771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=115ce5f41c0141dba0517bf9ba1bbec7, user_id=2041ef1ae732471b9bd071cfd4768937, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.331953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.344988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1015/2032] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:48 2022] PUT /identity/v3/projects/115ce5f41c0141dba0517bf9ba1bbec7/users/2041ef1ae732471b9bd071cfd4768937/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:48.356757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.357251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.357327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.387012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] MFA Rules not processed for user `2041ef1ae732471b9bd071cfd4768937`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:48.388217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:48.452896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1018/2033] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:48.462624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:48.464389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:48.523845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d63d28-7b36-4b9e-b6f6-63502de1c7bc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:48.527526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:48.528177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:48.528458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:48.528735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:48.537566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:48.538992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03045fe-963e-4d06-a79c-071b87867f2c service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:48.548195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1016/2034] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:55.766210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:55.827392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cd650-9fbf-4467-bd9d-c28631d25cc7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:55.834604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:55.835454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:55.835733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:55.836003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] PATH_INFO: `/v3/users/2041ef1ae732471b9bd071cfd4768937` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:55.837211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2041ef1ae732471b9bd071cfd4768937)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:55.839375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:55.887289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2041ef1ae732471b9bd071cfd4768937'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:55.887951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2041ef1ae732471b9bd071cfd4768937'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:55.901325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2041ef1ae732471b9bd071cfd4768937'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:55.909328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2041ef1ae732471b9bd071cfd4768937'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:55.910136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2041ef1ae732471b9bd071cfd4768937'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:55.921927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1019/2035] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:11:55 2022] DELETE /identity/v3/users/2041ef1ae732471b9bd071cfd4768937 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:55.928852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:55.928852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:55.928852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:55.943962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:55.945316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:56.016089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1017/2036] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:56.023213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.024737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:56.099919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2374d60-c7af-4f2e-9c9e-de2e636c4435 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.105148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.105882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.106173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.106447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.118785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.120618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7888bd-7d61-4071-98c8-038a118b296b service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.137804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1020/2037] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:11:56.397866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.399283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:56.410980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d054-5333-42d0-9d1b-4511efb48a23 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.415642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.416496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.416771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.417039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] PATH_INFO: `/v3/projects/115ce5f41c0141dba0517bf9ba1bbec7` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.418229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=115ce5f41c0141dba0517bf9ba1bbec7)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.420105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.478167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115ce5f41c0141dba0517bf9ba1bbec7', 'request_id': 'req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:56.484954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115ce5f41c0141dba0517bf9ba1bbec7', 'request_id': 'req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:56.491464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115ce5f41c0141dba0517bf9ba1bbec7', 'request_id': 'req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:56.502140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] The token cache is being invalidate because project 115ce5f41c0141dba0517bf9ba1bbec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:11:56.502421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:56.503047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7f80fdc2-95b3-4c5a-a6c5-ab5b03e027f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:11:56.504741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1018/2038] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:11:56 2022] DELETE /identity/v3/projects/115ce5f41c0141dba0517bf9ba1bbec7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:56.510122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.510253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.510517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.533831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:56.534521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:56.593465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1021/2039] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:56.601754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.602042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.602319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.622181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:56.623363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:56.631514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1019/2040] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:56.635683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.645757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48596af-b9de-4d53-a6f3-5ffe205ac568 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.650487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.651134 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.651408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.651676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.652390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:11:56.652693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.654295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.666290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1022/2041] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:11:56.670612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.679561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb8fc2-aa7c-4ce8-9342-f2c964f99fb9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.684938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.685611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.685890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.686168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.686860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.688740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.714815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1020/2042] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:56 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:56.718965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.729503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544317a-25c8-4899-b6f1-5467d600e497 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.781584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.782229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.782505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.782772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.783442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.785379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.805545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1023/2043] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:56 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:11:56.809629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.820245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a6a08-967f-46ee-a835-04bd6fe32624 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.825017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.825702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.825978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.826245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.827037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.828616 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.839080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1021/2044] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:56.842698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.852850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f8ea2-d7b2-4c85-b96b-87c2567eea71 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.857952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.858593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.858870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.859141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.859888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.862115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d48f74-bd98-47b5-95a9-4fa90caf35e4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.872062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1024/2045] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:56.876405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:56.886020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47f703-10ae-4e19-9571-da49feb6f8b6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:56.890712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:56.891572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.891850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.892161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] PATH_INFO: `/v3/projects/2b6dfb5b089141dbba09f543ad9774d5/users/435574926d4f401cbd2285469c35ca96/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.906163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6dfb5b089141dbba09f543ad9774d5, user_id=435574926d4f401cbd2285469c35ca96, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:56.909405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:56.922171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1022/2046] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:56 2022] PUT /identity/v3/projects/2b6dfb5b089141dbba09f543ad9774d5/users/435574926d4f401cbd2285469c35ca96/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:56.932785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:56.933105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:56.933380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:56.958288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] MFA Rules not processed for user `435574926d4f401cbd2285469c35ca96`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:56.959461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:57.018960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1025/2047] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:57.023426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.081610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a79c9c-7dbe-4c03-aa9e-6a4724429ea1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.086170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.086808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.087084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.087354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.088037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.089957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.115987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1023/2048] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:57.120168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.131728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19caee-369c-4631-a51c-d0ec0655b2c9 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.187415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.188193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.188477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.188752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.190121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.191859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.213796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1026/2049] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:57.220650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.227893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bbc82-7c79-41b9-afda-b1413a37664f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.232607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.233326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.233605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.233913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.234623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.236915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.247598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1024/2050] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:57.252207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.262705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377351c-4f15-4107-b8e1-1419a4ab556d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.267584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.268388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.268781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.269138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.269860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.271547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55cbd9-9fea-44e6-bdef-c7f331e32301 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.281484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1027/2051] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:57.285538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.295361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e6d3e-e1b1-4e49-8c24-fbd38978a12b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.300804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.301724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.302002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.302271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] PATH_INFO: `/v3/projects/5787f1c7dc6d41ebbbfc2d55aa52b753/users/4cf1f0bb09594769bcbce1d9b0a3cf3f/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.317325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5787f1c7dc6d41ebbbfc2d55aa52b753, user_id=4cf1f0bb09594769bcbce1d9b0a3cf3f, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.319910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.332514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1025/2052] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:57 2022] PUT /identity/v3/projects/5787f1c7dc6d41ebbbfc2d55aa52b753/users/4cf1f0bb09594769bcbce1d9b0a3cf3f/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:11:57.343641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.344124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.344539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.372624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] MFA Rules not processed for user `4cf1f0bb09594769bcbce1d9b0a3cf3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:57.373847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:57.435946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1028/2053] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:11:57.441119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.498336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3c7b1-af0e-4adc-a072-0f46f99d9b55 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.503221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.503861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.504143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.504471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.505176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.507027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.532096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1026/2054] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:57.536794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.547026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e5ed-26bc-41ce-9583-a38ed01e3a75 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.600380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.600956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.601268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.601559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.602231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.604150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.623034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1029/2055] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/users => generated 295 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:11:57.627786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.637875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734ada6-87d2-4c7b-8569-45518ffb0826 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.643031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.643678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.643957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.644231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.644945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.646560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.656587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1027/2056] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:11:57.660804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.670565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f1bd0-6413-441e-8ac8-99726bcf5172 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.675180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.676028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.676305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.676587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] PATH_INFO: `/v3/projects/04b6f252c9544aeb831320749e7eabb4/users/e2226c54b57a4364b6a36480cfffda1c/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.690902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b6f252c9544aeb831320749e7eabb4, user_id=e2226c54b57a4364b6a36480cfffda1c, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.693555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.706849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1030/2057] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:57 2022] PUT /identity/v3/projects/04b6f252c9544aeb831320749e7eabb4/users/e2226c54b57a4364b6a36480cfffda1c/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:57.710898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.721264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3662e-4efa-494a-994f-417a19820cfe admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.778540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.779241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.779518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.779791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.780520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.782117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae649b1-f6d1-42d3-a542-f0276979263e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.792337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1028/2058] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:11:57.796523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.807961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e137489-e169-4ae3-b0e3-7d31419b4ca7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:57.812795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:57.813694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.814016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.814290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] PATH_INFO: `/v3/projects/04b6f252c9544aeb831320749e7eabb4/users/e2226c54b57a4364b6a36480cfffda1c/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.816249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b6f252c9544aeb831320749e7eabb4, user_id=e2226c54b57a4364b6a36480cfffda1c, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:57.818942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:57.829556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1031/2059] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:11:57 2022] PUT /identity/v3/projects/04b6f252c9544aeb831320749e7eabb4/users/e2226c54b57a4364b6a36480cfffda1c/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:11:57.839976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:57.840262 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:57.840537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:57.867574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] MFA Rules not processed for user `e2226c54b57a4364b6a36480cfffda1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:11:57.868780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:57.936583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1029/2060] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:11:57.947183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:11:57.948881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:11:58.003783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48127f3d-a81d-45c7-a1f4-52fa72e6cf39 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:11:58.007396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:11:58.008017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:11:58.008295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:11:58.008568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:11:58.061593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:11:58.063000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:11:58.072352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1032/2061] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:11:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:02.862522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:02.864110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:02.878371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ea6fb-ca92-47c7-b6f4-2b41903d8f4a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:02.888804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:02.889511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:02.889799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:02.890075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:02.951765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:02.953309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:02.966315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1030/2062] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:03.516520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:03.526463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4edc65-2d8c-4925-ac16-fcab38611b80 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:03.530703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:03.531550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:03.532032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:03.533260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:03.547164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:03.550041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee92ddf-6af4-488f-a6aa-594685db29af service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:03.566690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1033/2063] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:04.001432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:04.002899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:04.065505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78c7c9-ddb6-4430-8dd0-ab28224bb428 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:04.069992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:04.070844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:04.071123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:04.071397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] PATH_INFO: `/v3/users/fdabfed36fb642d89177ef3d4d789022` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:04.072558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdabfed36fb642d89177ef3d4d789022)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:04.074477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:04.118806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdabfed36fb642d89177ef3d4d789022'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.119459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdabfed36fb642d89177ef3d4d789022'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.126078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdabfed36fb642d89177ef3d4d789022'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.126947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdabfed36fb642d89177ef3d4d789022'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.133789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdabfed36fb642d89177ef3d4d789022'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.150838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1031/2064] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:04 2022] DELETE /identity/v3/users/fdabfed36fb642d89177ef3d4d789022 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:04.155358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:04.155641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:04.155914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:04.172695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:04.174395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:04.227736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1034/2065] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:04.237849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:04.239235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:04.296369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1583a57-ab75-4e51-b785-254632bf1510 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:04.300748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:04.301431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:04.301716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:04.301988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:04.311533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:04.312876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:04.325485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1032/2066] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:12:04.666451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:04.667926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:04.679700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10fdf1-7f48-48a2-8669-ba809f02d31c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:04.684329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:04.685262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:04.685565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:04.685955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] PATH_INFO: `/v3/projects/676fe9f8d9bb4fd3819754d21171394a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:04.687163 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=676fe9f8d9bb4fd3819754d21171394a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:04.689754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:04.740171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676fe9f8d9bb4fd3819754d21171394a', 'request_id': 'req-e135e53d-1c33-4651-8f77-117c97d001ea'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.745813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676fe9f8d9bb4fd3819754d21171394a', 'request_id': 'req-e135e53d-1c33-4651-8f77-117c97d001ea'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.754301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676fe9f8d9bb4fd3819754d21171394a', 'request_id': 'req-e135e53d-1c33-4651-8f77-117c97d001ea'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.765838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] The token cache is being invalidate because project 676fe9f8d9bb4fd3819754d21171394a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:04.766047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.767294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.768978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1035/2067] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:04 2022] DELETE /identity/v3/projects/676fe9f8d9bb4fd3819754d21171394a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:04.773149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:04.784744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11befe8-96a5-490a-a38c-098010cbe8f2 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:04.850512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:04.851388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:04.851665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:04.852101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] PATH_INFO: `/v3/users/c6e65b4ba0804a69bc0757148942bb7f` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:04.853527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e65b4ba0804a69bc0757148942bb7f)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:04.855520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:04.915198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e65b4ba0804a69bc0757148942bb7f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.917750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e65b4ba0804a69bc0757148942bb7f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.926762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e65b4ba0804a69bc0757148942bb7f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.927662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e65b4ba0804a69bc0757148942bb7f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.935339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e65b4ba0804a69bc0757148942bb7f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:04.957622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1033/2068] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:04 2022] DELETE /identity/v3/users/c6e65b4ba0804a69bc0757148942bb7f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:05.286659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:05.288677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.304723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135e53d-1c33-4651-8f77-117c97d001ea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:05.375875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:05.379604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.382755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:05.383711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.384274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.384836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] PATH_INFO: `/v3/projects/caa99ee074974189925aeca383b51651` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.388076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa99ee074974189925aeca383b51651)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:05.390182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:05.398358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872869c-487a-432d-97d8-1e34f19167cb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:05.404155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:05.405286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.405516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.405849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] PATH_INFO: `/v3/users/bd49f0aa177049e881fc847fc4adaf17` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.407764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd49f0aa177049e881fc847fc4adaf17)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:05.410529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:05.450295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa99ee074974189925aeca383b51651', 'request_id': 'req-6054b0f9-5218-4e51-b31d-643632f11d80'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.457518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa99ee074974189925aeca383b51651', 'request_id': 'req-6054b0f9-5218-4e51-b31d-643632f11d80'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.467430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa99ee074974189925aeca383b51651', 'request_id': 'req-6054b0f9-5218-4e51-b31d-643632f11d80'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.476858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd49f0aa177049e881fc847fc4adaf17'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.477788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd49f0aa177049e881fc847fc4adaf17'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.483809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] The token cache is being invalidate because project caa99ee074974189925aeca383b51651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:05.484112 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.484906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.486619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd49f0aa177049e881fc847fc4adaf17'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.487354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd49f0aa177049e881fc847fc4adaf17'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.487637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1036/2069] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:05 2022] DELETE /identity/v3/projects/caa99ee074974189925aeca383b51651 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:05.491658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:05.493183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.496492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-26b2e1df-a7d9-4c41-bfa9-c4e8acbb4ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd49f0aa177049e881fc847fc4adaf17'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.516558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1034/2070] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:05 2022] DELETE /identity/v3/users/bd49f0aa177049e881fc847fc4adaf17 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:05.520987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.521413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.521797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.540998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:05.542243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.570231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054b0f9-5218-4e51-b31d-643632f11d80 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:05.608149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1035/2071] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:05.618568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:05.619976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.629226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:05.630092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.630375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.630651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] PATH_INFO: `/v3/users/e9726614d8bd4bf0bc6d80d25e1b065b` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.631932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9726614d8bd4bf0bc6d80d25e1b065b)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:05.633790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:05.682166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77161b8-531f-4f03-966e-bf0801bb1b93 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:05.682402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9726614d8bd4bf0bc6d80d25e1b065b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.683937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9726614d8bd4bf0bc6d80d25e1b065b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.687358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:05.688167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.688454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.689676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.691569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.697178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9726614d8bd4bf0bc6d80d25e1b065b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.708195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9726614d8bd4bf0bc6d80d25e1b065b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.708845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9726614d8bd4bf0bc6d80d25e1b065b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.711075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:05.712887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:05.726239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1037/2072] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:05 2022] DELETE /identity/v3/users/e9726614d8bd4bf0bc6d80d25e1b065b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:05.726337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1036/2073] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:12:05.726492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:05.727069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:05.818171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639cd9-5e8a-4e1f-bc1b-dce37b3cfbb9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:05.826817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f0865-c824-4c00-b489-853949370255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:05.827935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f0865-c824-4c00-b489-853949370255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:05.828464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f0865-c824-4c00-b489-853949370255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:05.828738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f0865-c824-4c00-b489-853949370255 admin admin] PATH_INFO: `/v3/users/0ebc08c05fa84a689f6d817fa4937546` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:05.830897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f0865-c824-4c00-b489-853949370255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ebc08c05fa84a689f6d817fa4937546)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:05.833152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f0865-c824-4c00-b489-853949370255 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:05.883148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ebc08c05fa84a689f6d817fa4937546'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.884230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ebc08c05fa84a689f6d817fa4937546'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.900664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ebc08c05fa84a689f6d817fa4937546'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.908903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ebc08c05fa84a689f6d817fa4937546'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.909862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ebc08c05fa84a689f6d817fa4937546'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:05.924937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1038/2074] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:05 2022] DELETE /identity/v3/users/0ebc08c05fa84a689f6d817fa4937546 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:06.139284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.151085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa733-55cd-4c7f-9b8f-0286295b769e service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.217521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.219653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.243460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.244378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.244662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.244938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] PATH_INFO: `/v3/projects/8860e437622b4f9bb4517159afb7f220` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.246451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8860e437622b4f9bb4517159afb7f220)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.248309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.316566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8860e437622b4f9bb4517159afb7f220', 'request_id': 'req-44d6f655-0601-43f6-8a7d-8c1d04537934'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.319394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f0865-c824-4c00-b489-853949370255 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.323953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8860e437622b4f9bb4517159afb7f220', 'request_id': 'req-44d6f655-0601-43f6-8a7d-8c1d04537934'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.331249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8860e437622b4f9bb4517159afb7f220', 'request_id': 'req-44d6f655-0601-43f6-8a7d-8c1d04537934'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.342039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] The token cache is being invalidate because project 8860e437622b4f9bb4517159afb7f220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:06.342350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.342978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.348428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1037/2075] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:06 2022] DELETE /identity/v3/projects/8860e437622b4f9bb4517159afb7f220 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:06.348428 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.348918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.385514 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.386411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.386691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.386963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] PATH_INFO: `/v3/projects/de9dd1b090b243e18dc6183b21c3b265` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.388172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9dd1b090b243e18dc6183b21c3b265)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.390091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.421803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6f655-0601-43f6-8a7d-8c1d04537934 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.427282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.428146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.428442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.428728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] PATH_INFO: `/v3/projects/a224aea079994bedb0f831b75e3e11a5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.429983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a224aea079994bedb0f831b75e3e11a5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.432081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.449813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9dd1b090b243e18dc6183b21c3b265', 'request_id': 'req-e4668191-179c-4bb3-885a-91769407cae4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.458013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9dd1b090b243e18dc6183b21c3b265', 'request_id': 'req-e4668191-179c-4bb3-885a-91769407cae4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.468524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9dd1b090b243e18dc6183b21c3b265', 'request_id': 'req-e4668191-179c-4bb3-885a-91769407cae4'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.481035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] The token cache is being invalidate because project de9dd1b090b243e18dc6183b21c3b265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:06.481424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.482125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e4668191-179c-4bb3-885a-91769407cae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.483719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1039/2076] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:06 2022] DELETE /identity/v3/projects/de9dd1b090b243e18dc6183b21c3b265 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:06.485211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bddb66-8937-4b83-a629-46cd577804d4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.485310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bddb66-8937-4b83-a629-46cd577804d4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.485661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bddb66-8937-4b83-a629-46cd577804d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.491557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a224aea079994bedb0f831b75e3e11a5', 'request_id': 'req-fd3481da-c041-4de5-b946-70659e0c0ba7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.502017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a224aea079994bedb0f831b75e3e11a5', 'request_id': 'req-fd3481da-c041-4de5-b946-70659e0c0ba7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.510270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a224aea079994bedb0f831b75e3e11a5', 'request_id': 'req-fd3481da-c041-4de5-b946-70659e0c0ba7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.513169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-85bddb66-8937-4b83-a629-46cd577804d4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:06.514876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-85bddb66-8937-4b83-a629-46cd577804d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.524257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] The token cache is being invalidate because project a224aea079994bedb0f831b75e3e11a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:06.524711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.525488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.528183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1038/2077] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:06 2022] DELETE /identity/v3/projects/a224aea079994bedb0f831b75e3e11a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:06.532056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.534345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.611200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1040/2078] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:06.619273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.619545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.619813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.625113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3481da-c041-4de5-b946-70659e0c0ba7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.632085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.633003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.633276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.633550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] PATH_INFO: `/v3/users/c53a2f814a474b908016162ac9530d63` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.634875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53a2f814a474b908016162ac9530d63)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.638157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.646554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:06.648171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.665029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1041/2079] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:06.666885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.680681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78da050-2f8e-428b-b29e-db9fdf74fa5e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.686554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.687817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.688093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.688385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.690140 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:06.690579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.693116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.706331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53a2f814a474b908016162ac9530d63'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.707310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53a2f814a474b908016162ac9530d63'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.711929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1042/2080] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:12:06.712873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.714636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:06.716057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53a2f814a474b908016162ac9530d63'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.716829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53a2f814a474b908016162ac9530d63'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.725154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53a2f814a474b908016162ac9530d63'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:06.729320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1335f-f2ac-4877-8bf0-fd90f732d778 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.734360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.735021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.735282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.735584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.736634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.738603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.743782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1039/2081] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:06 2022] DELETE /identity/v3/users/c53a2f814a474b908016162ac9530d63 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:06.771933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1043/2082] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:06 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:06.773177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.848409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb42aa-218b-4cd6-bb7f-296eb3cdb8c3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.914962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.916257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.916595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.916875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.917854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.920329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.951108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1040/2083] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:06 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:06.955519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:06.967766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420fa1d-ff8b-472d-9b66-58be9c97f8ed admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:06.973311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:06.974611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:06.974896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:06.975169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:06.975898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:06.977504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:06.990983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1044/2084] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:06.994549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.006337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09e4bb-d291-4191-8383-c8fb30f0a2fa admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.011433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.012222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.012409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.012674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.013438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.015197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb73ebc-f713-442d-a04b-1c1b1594c459 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.029105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1041/2085] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:07.034133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.045002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b366e0-830a-4afc-a6c2-24af2970f666 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.051302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.052190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.052473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.053390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] PATH_INFO: `/v3/projects/a7aaea837bf040918e2395f1e274186d/users/6b7023aa6bc643c4b0048ecb32fde4a7/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.076262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7aaea837bf040918e2395f1e274186d, user_id=6b7023aa6bc643c4b0048ecb32fde4a7, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.078974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.093019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1045/2086] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:07 2022] PUT /identity/v3/projects/a7aaea837bf040918e2395f1e274186d/users/6b7023aa6bc643c4b0048ecb32fde4a7/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:07.103483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.103776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.104056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.131275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] MFA Rules not processed for user `6b7023aa6bc643c4b0048ecb32fde4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:07.132510 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.200902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1042/2087] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:07.206508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.212216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.213820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.299803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80911-dd98-431e-93d5-da9df47388ec None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.299992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96267ae-c0aa-4b80-95a6-d2075fa367f1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.305763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.306494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.306693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.306973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.307676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.308504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.311714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.311714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.311714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] PATH_INFO: `/v3/projects/24f7d42c0d4342099f20a66da680dadd` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.311939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.312112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f7d42c0d4342099f20a66da680dadd)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.314323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.352223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1046/2088] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:07.356529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.378746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f7d42c0d4342099f20a66da680dadd', 'request_id': 'req-15f6b095-e7e2-45d9-85f1-e507fec19d82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.392912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f7d42c0d4342099f20a66da680dadd', 'request_id': 'req-15f6b095-e7e2-45d9-85f1-e507fec19d82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.399723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f7d42c0d4342099f20a66da680dadd', 'request_id': 'req-15f6b095-e7e2-45d9-85f1-e507fec19d82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.410997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] The token cache is being invalidate because project 24f7d42c0d4342099f20a66da680dadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:07.411287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.412125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-15f6b095-e7e2-45d9-85f1-e507fec19d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.414100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1043/2089] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:07 2022] DELETE /identity/v3/projects/24f7d42c0d4342099f20a66da680dadd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:07.418579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6ce-f3c2-4ed3-b9d3-a6b5e7d20c8b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.418922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6ce-f3c2-4ed3-b9d3-a6b5e7d20c8b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.419146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28d6ce-f3c2-4ed3-b9d3-a6b5e7d20c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.442601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0488b8b-f653-4649-8a4c-815968b4acef admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.443376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ae28d6ce-f3c2-4ed3-b9d3-a6b5e7d20c8b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:07.444583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ae28d6ce-f3c2-4ed3-b9d3-a6b5e7d20c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.512910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.513629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.513884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.514105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.514798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.517382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.538909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1044/2090] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:07.542895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.543186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.543466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.546332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1047/2091] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:07.550988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.554109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.569358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b447a3-5f0b-4d0c-a3cc-178e17b0abaa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.574531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.575195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.575542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.575820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.576553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.578158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.582756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:07.584218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.589404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1048/2092] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:07.590409 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.592189 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.595876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1045/2093] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:07.595876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.605376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14e4f0-d0bf-4514-b662-50f31fabfdfc None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.607668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8ec15-1d74-4a69-920f-cf70100dc563 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.610173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.611206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.611493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.611871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] PATH_INFO: `/v3/projects/afcc5189a52248bc8d9fecbe917804a6/users/5e10db51bd244e4abb9a6194a63c1d93/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.612927 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.613904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.614207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.614483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] PATH_INFO: `/v3/users/435574926d4f401cbd2285469c35ca96` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.615684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435574926d4f401cbd2285469c35ca96)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.617611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.631010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcc5189a52248bc8d9fecbe917804a6, user_id=5e10db51bd244e4abb9a6194a63c1d93, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.634266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.650200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1046/2094] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:07 2022] PUT /identity/v3/projects/afcc5189a52248bc8d9fecbe917804a6/users/5e10db51bd244e4abb9a6194a63c1d93/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:07.651021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.668350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435574926d4f401cbd2285469c35ca96'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.669014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435574926d4f401cbd2285469c35ca96'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.680636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435574926d4f401cbd2285469c35ca96'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.690792 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435574926d4f401cbd2285469c35ca96'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.691585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435574926d4f401cbd2285469c35ca96'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.705554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1049/2095] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:07 2022] DELETE /identity/v3/users/435574926d4f401cbd2285469c35ca96 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:07.709740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.711449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.715835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f79d9-702e-4db2-abc1-0fe8f6c0ba45 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.777100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.777787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.778070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.778357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.779586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:07.780641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a85d2-ab23-425b-a343-e58c8bb40969 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.781443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.783275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe3fcd-4760-41f5-866a-a607c336d0dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.786680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.787521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.788601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.788880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.789638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.791224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.803439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1047/2096] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:07.803439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.803439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.803439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.803808 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1050/2097] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:07.806288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.808316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.821333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:07.822606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.825397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21f2bd-2d90-453c-be8a-6413906db91f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.830590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1048/2098] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:07.831687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.834272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.835144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.835849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.835849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.836899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.839707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.841423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40b2cb-3619-45f6-a27e-bc13baea2a82 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.846330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.847017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.847298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.847565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] PATH_INFO: `/v3/projects/afcc5189a52248bc8d9fecbe917804a6/users/5e10db51bd244e4abb9a6194a63c1d93/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.849724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcc5189a52248bc8d9fecbe917804a6, user_id=5e10db51bd244e4abb9a6194a63c1d93, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.854015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.864734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1049/2099] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:07 2022] PUT /identity/v3/projects/afcc5189a52248bc8d9fecbe917804a6/users/5e10db51bd244e4abb9a6194a63c1d93/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:07.865735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.876004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.878926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1051/2100] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:07 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:07.879766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:07.881732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:07.935881 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8a20-2a2f-447b-9a5a-91f63e5a6d0a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.944480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e77a5-3124-40cf-8921-99844ced6ca0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:07.949506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.950359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.950636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.950909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] PATH_INFO: `/v3/users/0aaa7091f48849a9bc1541c7b9504958` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.952114 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aaa7091f48849a9bc1541c7b9504958)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.954597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.983863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:07.984492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:07.984774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:07.985067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:07.994251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:07.995665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8be3ca-bdbc-4245-89a9-b65814046603 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:07.999393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aaa7091f48849a9bc1541c7b9504958'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:07.999984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aaa7091f48849a9bc1541c7b9504958'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.005426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1050/2101] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:08.006725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.006951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.007205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.018312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aaa7091f48849a9bc1541c7b9504958'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.026762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aaa7091f48849a9bc1541c7b9504958'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.027422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aaa7091f48849a9bc1541c7b9504958'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.034777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] MFA Rules not processed for user `5e10db51bd244e4abb9a6194a63c1d93`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:08.035972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.043192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1052/2102] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:07 2022] DELETE /identity/v3/users/0aaa7091f48849a9bc1541c7b9504958 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:08.043192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.043192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.127911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1051/2103] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:08.135184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.137617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9884be-9f7d-45e8-8c92-33899e88d863 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.137777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.143296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.143970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.144249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.144533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.145420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.148151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.173120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1053/2104] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:08 2022] POST /identity/v3/users => generated 305 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:08.177732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.198028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1af97b-2cc9-4845-9d89-bfcfd7346cbb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.209639 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.210075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.210356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.210628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.211635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.212651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b6a4b-f22d-4211-86a0-99bea19ed201 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.213025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.229357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1054/2105] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:08.234197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.246911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82b591-323d-4793-b89d-6ecd3218b1e1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.254389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.255092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.255476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.255856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.256688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.258642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.269949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1055/2106] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:08.274036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.280051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.280699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.280981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.281597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.288583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb5dd8-c3b5-4208-b020-29c02b7a6b21 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.295594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.296586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.297242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.297358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] PATH_INFO: `/v3/projects/8ec7357f789a4f17a349e898118d1e1e/users/a80a701c83e841289afb82c7f882902e/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.312928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec7357f789a4f17a349e898118d1e1e, user_id=a80a701c83e841289afb82c7f882902e, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.317137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fb53-6b04-4a99-8c5e-575f9f84fac0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.343520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1056/2107] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:08 2022] PUT /identity/v3/projects/8ec7357f789a4f17a349e898118d1e1e/users/a80a701c83e841289afb82c7f882902e/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:08.352564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.353920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.354943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.355382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.356546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.365289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1052/2108] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:08.392670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] MFA Rules not processed for user `a80a701c83e841289afb82c7f882902e`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:08.393721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.469499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.471422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.488656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1057/2109] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:08.493499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.494827 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66049994-bc69-4e5d-b2df-daae68c52eb8 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.583087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.584054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.584407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.584915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] PATH_INFO: `/v3/projects/e4c858e99739411b8b417afe681ffe2a` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.586273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c858e99739411b8b417afe681ffe2a)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.588282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.591648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274f65-2455-4182-998c-297aa8cae1a8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.597044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.597742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.598023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.598295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.598982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.600854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.642706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1058/2110] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:08 2022] POST /identity/v3/projects => generated 409 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:08.643555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.645231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.651384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c858e99739411b8b417afe681ffe2a', 'request_id': 'req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.660135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c858e99739411b8b417afe681ffe2a', 'request_id': 'req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.667623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c858e99739411b8b417afe681ffe2a', 'request_id': 'req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.682626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] The token cache is being invalidate because project e4c858e99739411b8b417afe681ffe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:08.682962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.683591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.689086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1053/2111] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:08 2022] DELETE /identity/v3/projects/e4c858e99739411b8b417afe681ffe2a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:08.689744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.691128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.721236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0289485-a98b-4603-a808-2a0832c68246 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.726081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.727100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.727363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.727662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] PATH_INFO: `/v3/projects/2b6dfb5b089141dbba09f543ad9774d5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.729061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6dfb5b089141dbba09f543ad9774d5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.731397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.757638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a07d-dc08-41cc-9697-2db6ca7c6163 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.762651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.763319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.763601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.763873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.764560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.767057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.789025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1054/2112] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:08 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:08.792492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6dfb5b089141dbba09f543ad9774d5', 'request_id': 'req-7e367f27-9ac8-47bc-9957-9b967ff2274f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.793277 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.795893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.798325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6dfb5b089141dbba09f543ad9774d5', 'request_id': 'req-7e367f27-9ac8-47bc-9957-9b967ff2274f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.806282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6dfb5b089141dbba09f543ad9774d5', 'request_id': 'req-7e367f27-9ac8-47bc-9957-9b967ff2274f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.808055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca693-49b0-419d-9d82-ed578d1ece73 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.817526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] The token cache is being invalidate because project 2b6dfb5b089141dbba09f543ad9774d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:08.817841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.818520 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.820328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1059/2113] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:08 2022] DELETE /identity/v3/projects/2b6dfb5b089141dbba09f543ad9774d5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:08.821188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.822494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.863294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.864298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.864642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.864985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] PATH_INFO: `/v3/users/d44e1c5c9b9c4bed94da4ec05d83c8b3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.866272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44e1c5c9b9c4bed94da4ec05d83c8b3)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.868169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.885774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e367f27-9ac8-47bc-9957-9b967ff2274f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.890910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.892160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.892530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.892860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.893729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.895540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.907481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1060/2114] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:08.908627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.911025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.923480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bc6ac-06cb-4b7f-8e1f-f8ac6bb1980f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:08.924116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44e1c5c9b9c4bed94da4ec05d83c8b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.924802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44e1c5c9b9c4bed94da4ec05d83c8b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.928855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:08.929789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:08.930128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:08.930378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] PATH_INFO: `/v3/users/6b7023aa6bc643c4b0048ecb32fde4a7` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:08.931675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7023aa6bc643c4b0048ecb32fde4a7)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:08.932506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44e1c5c9b9c4bed94da4ec05d83c8b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.933284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44e1c5c9b9c4bed94da4ec05d83c8b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.933686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:08.940849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44e1c5c9b9c4bed94da4ec05d83c8b3'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.958473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1055/2115] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:08 2022] DELETE /identity/v3/users/d44e1c5c9b9c4bed94da4ec05d83c8b3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:08.959608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:08.960985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:08.980752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7023aa6bc643c4b0048ecb32fde4a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.981515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7023aa6bc643c4b0048ecb32fde4a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:08.998221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7023aa6bc643c4b0048ecb32fde4a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.007597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7023aa6bc643c4b0048ecb32fde4a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.008236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7023aa6bc643c4b0048ecb32fde4a7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.024576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1061/2116] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:08 2022] DELETE /identity/v3/users/6b7023aa6bc643c4b0048ecb32fde4a7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.024576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.024576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.030494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d215-2701-4427-9f83-9fca7201a28c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.087151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.088096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.088465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.094078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] PATH_INFO: `/v3/users/4cf1f0bb09594769bcbce1d9b0a3cf3f` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.094228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b847692-6b9b-4a22-bf73-5d3f28d8172d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.094325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf1f0bb09594769bcbce1d9b0a3cf3f)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.094325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.100577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.101600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.101876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.102145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] PATH_INFO: `/v3/projects/040130c4dc554d1f80f71ba6b9793516/users/db7ccc033abd4b60ab9c9b6c866d6588/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.118205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040130c4dc554d1f80f71ba6b9793516, user_id=db7ccc033abd4b60ab9c9b6c866d6588, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.121268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b965da-4bf0-4a78-8982-f0a43bb28126 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.144288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1062/2117] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:09 2022] PUT /identity/v3/projects/040130c4dc554d1f80f71ba6b9793516/users/db7ccc033abd4b60ab9c9b6c866d6588/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.145852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.146291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.146856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.147576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf1f0bb09594769bcbce1d9b0a3cf3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.148455 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf1f0bb09594769bcbce1d9b0a3cf3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.158871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf1f0bb09594769bcbce1d9b0a3cf3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.159514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf1f0bb09594769bcbce1d9b0a3cf3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.167245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf1f0bb09594769bcbce1d9b0a3cf3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.172087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:09.174042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.186999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1056/2118] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:08 2022] DELETE /identity/v3/users/4cf1f0bb09594769bcbce1d9b0a3cf3f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.187679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.189309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.242216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1063/2119] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:09.243158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.244570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.258763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecd8850-feee-49d2-a6d2-a0be1df61c3b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.264376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.264598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298a977-d291-469c-b3ee-f3937ba7cff0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.265048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.265375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.265659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.267004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.268740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.271984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.273261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.273811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.274088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] PATH_INFO: `/v3/projects/e8f5b42d9d3644ad9730942807e3d551` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.275537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f5b42d9d3644ad9730942807e3d551)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.277531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.279329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1064/2120] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:09.279955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.281821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.325406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f5b42d9d3644ad9730942807e3d551', 'request_id': 'req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.334433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f5b42d9d3644ad9730942807e3d551', 'request_id': 'req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.340924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f5b42d9d3644ad9730942807e3d551', 'request_id': 'req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.350251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c8e3-9850-45f7-8d66-c2f560e42544 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.352618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] The token cache is being invalidate because project e8f5b42d9d3644ad9730942807e3d551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:09.353202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.357181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.364965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1057/2121] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:09 2022] DELETE /identity/v3/projects/e8f5b42d9d3644ad9730942807e3d551 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.364965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.367337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.418779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.419531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.419872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.420217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.423805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.441793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cc7e5-9e73-47b2-a51a-b09a96f06ff4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.447965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.448981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.449362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.449756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] PATH_INFO: `/v3/projects/040130c4dc554d1f80f71ba6b9793516/users/db7ccc033abd4b60ab9c9b6c866d6588/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.451928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040130c4dc554d1f80f71ba6b9793516, user_id=db7ccc033abd4b60ab9c9b6c866d6588, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.455504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ad8d8-7471-4b6d-8b24-25b7a27855a3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.471340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1058/2122] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:09 2022] PUT /identity/v3/projects/040130c4dc554d1f80f71ba6b9793516/users/db7ccc033abd4b60ab9c9b6c866d6588/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.481442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.481951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.482575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.506290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:09.507624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.516117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.517755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763fa82-460e-4650-be4e-9c6d1a061c2b service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.528260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1065/2123] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:09.529509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cc5aa-33a5-4e1e-88a1-160b6288a358 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.529801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cc5aa-33a5-4e1e-88a1-160b6288a358 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.530142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cc5aa-33a5-4e1e-88a1-160b6288a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.562734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7f4cc5aa-33a5-4e1e-88a1-160b6288a358 None None] MFA Rules not processed for user `db7ccc033abd4b60ab9c9b6c866d6588`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:09.564569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7f4cc5aa-33a5-4e1e-88a1-160b6288a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.587348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1059/2124] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:09.588211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.589547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.602853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99971226-eae2-49b6-9baa-ea07e9e64312 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.607992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.608846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.609165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.609437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] PATH_INFO: `/v3/projects/5787f1c7dc6d41ebbbfc2d55aa52b753` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.610669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5787f1c7dc6d41ebbbfc2d55aa52b753)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.612694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.647644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1066/2125] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:09.649265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.649548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.649820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.671505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5787f1c7dc6d41ebbbfc2d55aa52b753', 'request_id': 'req-1b505f66-ac4c-4c39-b99d-cf3610b252cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.682067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5787f1c7dc6d41ebbbfc2d55aa52b753', 'request_id': 'req-1b505f66-ac4c-4c39-b99d-cf3610b252cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.687458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:09.689251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.691248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5787f1c7dc6d41ebbbfc2d55aa52b753', 'request_id': 'req-1b505f66-ac4c-4c39-b99d-cf3610b252cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.705815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] The token cache is being invalidate because project 5787f1c7dc6d41ebbbfc2d55aa52b753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:09.706176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.707065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.708988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1060/2126] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:09 2022] DELETE /identity/v3/projects/5787f1c7dc6d41ebbbfc2d55aa52b753 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.709667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.711044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.758457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1067/2127] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:09.761362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.773267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b505f66-ac4c-4c39-b99d-cf3610b252cb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.773884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.777227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.778335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.778568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.778831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.780584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.785649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f25b-fc51-4eb0-8fa5-e69b97f22b68 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.790654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.791521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.791788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.792061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] PATH_INFO: `/v3/users/e2226c54b57a4364b6a36480cfffda1c` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.793271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2226c54b57a4364b6a36480cfffda1c)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.795169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.847213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2226c54b57a4364b6a36480cfffda1c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.847893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2226c54b57a4364b6a36480cfffda1c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.850986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.852403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.860341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2226c54b57a4364b6a36480cfffda1c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.862775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1061/2128] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:09.863730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.872323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2226c54b57a4364b6a36480cfffda1c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.873628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2226c54b57a4364b6a36480cfffda1c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:09.875705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40201c8-b5fd-4fd2-81d4-97739839ba03 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:09.880755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:09.881539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:09.881888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:09.882229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:09.883025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:09.883421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:09.885045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:09.893455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1068/2129] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:09 2022] DELETE /identity/v3/users/e2226c54b57a4364b6a36480cfffda1c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:09.901301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1062/2130] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:09.904048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.906787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.921825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:09.925393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:09.961397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3df20f-eca2-4be9-b50f-170b70e589a1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.004793 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1bb44-8af5-4037-9d50-96665e270fff admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.011491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.012143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.012424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.012696 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.013423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.015300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.039154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.040233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.040665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.041028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] PATH_INFO: `/v3/projects/a7aaea837bf040918e2395f1e274186d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.042651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7aaea837bf040918e2395f1e274186d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.044635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.048239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1069/2131] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:09 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:10.052091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.115892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7aaea837bf040918e2395f1e274186d', 'request_id': 'req-7015ca40-d0e3-45e6-9291-34c35933c715'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.129096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7aaea837bf040918e2395f1e274186d', 'request_id': 'req-7015ca40-d0e3-45e6-9291-34c35933c715'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.134730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7aaea837bf040918e2395f1e274186d', 'request_id': 'req-7015ca40-d0e3-45e6-9291-34c35933c715'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.143761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b5b9a-ed90-4503-a6d2-78d79b9a9801 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.146202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] The token cache is being invalidate because project a7aaea837bf040918e2395f1e274186d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:10.146554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.147281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.148893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1063/2132] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:09 2022] DELETE /identity/v3/projects/a7aaea837bf040918e2395f1e274186d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:10.149773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.151098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.214235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015ca40-d0e3-45e6-9291-34c35933c715 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.215405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.216070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.216788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.217046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.217788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.219356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.220315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.221202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.221661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.221943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.224058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.250878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1070/2133] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:10.250878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.252482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.269920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbc09f-cc06-4f9c-a371-25d4071f368b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.277881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.278914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.279199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.279474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] PATH_INFO: `/v3/users/5e10db51bd244e4abb9a6194a63c1d93` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.280697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e10db51bd244e4abb9a6194a63c1d93)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.283281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.288682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.290131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.299523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1064/2134] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:10.300320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.301619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.316527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daba02-df59-408b-b899-b25b6fafff26 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.322619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.323472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.323866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.324166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] PATH_INFO: `/v3/projects/04b6f252c9544aeb831320749e7eabb4` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.325381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b6f252c9544aeb831320749e7eabb4)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.327357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.333898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e10db51bd244e4abb9a6194a63c1d93'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.334631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e10db51bd244e4abb9a6194a63c1d93'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.349264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e10db51bd244e4abb9a6194a63c1d93'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.357388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e10db51bd244e4abb9a6194a63c1d93'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.358208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e10db51bd244e4abb9a6194a63c1d93'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.373480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1071/2135] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:10 2022] DELETE /identity/v3/users/5e10db51bd244e4abb9a6194a63c1d93 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:10.377726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.380104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.382976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b6f252c9544aeb831320749e7eabb4', 'request_id': 'req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.392044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b6f252c9544aeb831320749e7eabb4', 'request_id': 'req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.399061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b6f252c9544aeb831320749e7eabb4', 'request_id': 'req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.413721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] The token cache is being invalidate because project 04b6f252c9544aeb831320749e7eabb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:10.414148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.414874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-069ea06e-bdbe-4593-8ecc-1c1910e0aea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.420079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1065/2136] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:10 2022] DELETE /identity/v3/projects/04b6f252c9544aeb831320749e7eabb4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:10.422391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cabf-cfb6-4334-b390-7dc3606da47e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.423441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cabf-cfb6-4334-b390-7dc3606da47e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.423990 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56cabf-cfb6-4334-b390-7dc3606da47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.452416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7d56cabf-cfb6-4334-b390-7dc3606da47e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:10.453992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7d56cabf-cfb6-4334-b390-7dc3606da47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.461981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5608f-8c8c-4ffc-9dcb-b0430675e833 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.466863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1066/2137] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:10.467810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.468484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.468771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.469049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.470478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.472357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.476739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.477288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.477550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.488629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1072/2138] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:10.489569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.492118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.497971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:10.499332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.506735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087abb2-a1c4-4ce0-8088-ea6b6d322fe3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.509861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1067/2139] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:10.512283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.513036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.513353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.513642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.514354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.514917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.516539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.525712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824d86c-8ffb-4ada-9672-1e9c893fe856 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.528553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1073/2140] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:10.533319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.536971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.537818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.538197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.538569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.540776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:10.541274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.543760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.544621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b76cd-8c84-4021-a4e4-e36d507a2fe0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.550564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.551610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.551894 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.552165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] PATH_INFO: `/v3/projects/ee52cb5c99a64176b601486924ce1f8e/users/9636311536284bd786491be9d182159a/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.571151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee52cb5c99a64176b601486924ce1f8e, user_id=9636311536284bd786491be9d182159a, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.578518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1068/2141] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:10.581883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d2ee3-7e50-446e-b0f3-d4fd140e834e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.582385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.596585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62bfc1-4009-40cf-b1f5-9dad927ad105 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.600496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1074/2142] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:10 2022] PUT /identity/v3/projects/ee52cb5c99a64176b601486924ce1f8e/users/9636311536284bd786491be9d182159a/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:10.625013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.625630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.626412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.678680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] MFA Rules not processed for user `9636311536284bd786491be9d182159a`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:10.687686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.687686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.687686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.687686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.688891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.688891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.689037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.741232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1069/2143] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:10.742694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.796811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1075/2144] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:10.798809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.800769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.816880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b901d99-a842-4cfa-97ab-e306365747f3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.820079 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257586f-d7fe-428d-a02c-c23536ba68c2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.830740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.832175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.833035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.833381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.833620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] PATH_INFO: `/v3/projects/afcc5189a52248bc8d9fecbe917804a6` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.834210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.834501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.834773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.835473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.837461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.838446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcc5189a52248bc8d9fecbe917804a6)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.840861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:10.862472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1070/2145] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:10 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:10.863326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.866547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.895956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcc5189a52248bc8d9fecbe917804a6', 'request_id': 'req-1efa2eb3-b40f-404d-aba4-f48e77026d6c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.901738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcc5189a52248bc8d9fecbe917804a6', 'request_id': 'req-1efa2eb3-b40f-404d-aba4-f48e77026d6c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.910067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcc5189a52248bc8d9fecbe917804a6', 'request_id': 'req-1efa2eb3-b40f-404d-aba4-f48e77026d6c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.920874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] The token cache is being invalidate because project afcc5189a52248bc8d9fecbe917804a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:10.921195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.921842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:10.924075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1076/2146] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:10 2022] DELETE /identity/v3/projects/afcc5189a52248bc8d9fecbe917804a6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:10.924828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:10.926121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.933392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a0c86-9857-42a3-a82d-98910281cd2e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.980377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.981138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.981375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.981708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.984004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:10.991248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa2eb3-b40f-404d-aba4-f48e77026d6c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:10.995959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:10.996603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:10.996877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:10.997194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:10.997938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:10.999497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22729d05-07ba-48a4-8462-1adbb264dbb0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.009660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1077/2147] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:11.011182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.011472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.011745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.031352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:11.033201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:11.042141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1078/2148] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:11.042852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.052148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b2688-7582-4e7d-a014-0332166acdd5 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.053725 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.055316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103462a-44cb-476c-b0f5-8cec84a7675f service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.056860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.057542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.057824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.058097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.058848 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.060427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.064461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1071/2149] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:11.065757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.066041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.066312 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.071135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1079/2150] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:11.074901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.085255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f739234-3917-4ae4-9486-376ea0c2fd1a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.085621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:11.086825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:11.096580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.097640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.097948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.098243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] PATH_INFO: `/v3/projects/d7546f6820b84b859304eb8302d72c6a/users/9dd50092ed9545eaae3727d29fc4e8cb/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.102390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1072/2151] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:11.106535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.113640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7546f6820b84b859304eb8302d72c6a, user_id=9dd50092ed9545eaae3727d29fc4e8cb, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.115580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b2d13-49b3-46c7-a5e8-1da87350c840 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.116279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b5e85-55cc-44e1-a627-923bc0cbeebf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.122440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.123194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.123584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.123788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.124520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:11.124791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.127200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.133938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1080/2152] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:11 2022] PUT /identity/v3/projects/d7546f6820b84b859304eb8302d72c6a/users/9dd50092ed9545eaae3727d29fc4e8cb/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:11.143859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1073/2153] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:12:11.145377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.145503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.145682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.145955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.155922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2144-30cd-4727-9c81-72289d05d159 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.172786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] MFA Rules not processed for user `9dd50092ed9545eaae3727d29fc4e8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:11.174373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:11.217733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.218626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.218919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.219225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.219948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.221986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.245323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1081/2154] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:11.257713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1074/2155] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:11.258926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.259461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.261264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:11.271796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e609a-4b64-46f1-b528-31b93655cea7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.323978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58a1fa-580f-4fd7-872f-a104a1ee2f87 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.334607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.334607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.334607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.335086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.339917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.340586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.340864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.341169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.341864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.343777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.374782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1082/2156] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:11.380152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.400400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9def28-b787-43e3-8264-56c9e1a9511e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.406910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.408103 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.408387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.408491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.408658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.409431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.410463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.411002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.420791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1075/2157] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:12:11.426466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1083/2158] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:11.430167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.446907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badc1f9-ce70-4235-acd2-89c282e4f975 service glance] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.449495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.450117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.450398 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.450671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.451400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.453208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631f00-fe84-426f-9a40-3e3a914ada63 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.463899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1076/2159] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:11.468300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.479331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c42c8-bdbd-41f6-a1ec-f32e38f1b5df admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.484029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.484935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.485812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.486100 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] PATH_INFO: `/v3/projects/31e8a8bbb0d14004b08d4a9135fbb2f0/users/a9e90254520848e78fe887407e0ad539/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.501610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e8a8bbb0d14004b08d4a9135fbb2f0, user_id=a9e90254520848e78fe887407e0ad539, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.504243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.517915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1084/2160] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:11 2022] PUT /identity/v3/projects/31e8a8bbb0d14004b08d4a9135fbb2f0/users/a9e90254520848e78fe887407e0ad539/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:11.528132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.528763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.528763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.558763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] MFA Rules not processed for user `a9e90254520848e78fe887407e0ad539`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:11.559953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:11.625154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1077/2161] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:11.627365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.692688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbc104-0963-4619-ac1d-32f5202d3c72 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.697661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.698318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.698603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.698872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.699571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.701632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.728837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1085/2162] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:11.733306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.751524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fcc8b-93b4-47b7-b164-fdfa83286b2a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.814716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.815311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.815746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.816022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.816716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.818663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.841785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1078/2163] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:11 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:11.846547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.857250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ba39-efa9-47ad-9275-4b88c6028c5c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.862608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.863282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.863545 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.863816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.864609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.866168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.879508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1086/2164] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:11.883767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:11.895116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471f1ed-80b4-4d21-a353-9a2e74bbe2ac admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:11.901813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:11.902938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:11.903218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:11.903483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] PATH_INFO: `/v3/projects/934c2a1fc7a14b38997681a9f2a6e725/users/63554c2db85f4429a4819b89e5df052f/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:11.949144 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c2a1fc7a14b38997681a9f2a6e725, user_id=63554c2db85f4429a4819b89e5df052f, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:11.952690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:11.984418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1079/2165] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:11 2022] PUT /identity/v3/projects/934c2a1fc7a14b38997681a9f2a6e725/users/63554c2db85f4429a4819b89e5df052f/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:11.989347 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:12.001813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5966c5b-5b16-4a20-90de-d46c9419bbc9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:12.067971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:12.068600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:12.068884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:12.069188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:12.069924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:12.071700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671d232-44d9-4870-a531-aacbe7cbcd9f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:12.085447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1087/2166] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:12.087068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:12.097534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc4b7f-a082-4264-8a45-fc4021cfa0fc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:12.102539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:12.103531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:12.103876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:12.104231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] PATH_INFO: `/v3/projects/934c2a1fc7a14b38997681a9f2a6e725/users/63554c2db85f4429a4819b89e5df052f/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:12.106293 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934c2a1fc7a14b38997681a9f2a6e725, user_id=63554c2db85f4429a4819b89e5df052f, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:12.108951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:12.119361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1080/2167] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:12 2022] PUT /identity/v3/projects/934c2a1fc7a14b38997681a9f2a6e725/users/63554c2db85f4429a4819b89e5df052f/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:12.131748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:12.132040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:12.132316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:12.159187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] MFA Rules not processed for user `63554c2db85f4429a4819b89e5df052f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:12.160370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:12.225441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1088/2168] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:12.236674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:12.238675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:12.295731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8173daa3-2102-40a6-a6c0-920e5b64d500 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:12.299437 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:12.300068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:12.300344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:12.300613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:12.309756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:12.311159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:12.320371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1081/2169] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:12.362454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:12.365048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:12.376807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34b97-aec6-4c99-b376-a24e04e3e424 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:12.380720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:12.381382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:12.381660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:12.381933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:12.442638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:12.444115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992173fb-4ef0-45f2-b06c-a0a2d396da21 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:12.455875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1089/2170] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:15.686512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:15.750757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21fc51-1cfa-434d-91b3-8e5d325fb71d service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:15.755842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:15.756769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:15.757048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:15.757347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] PATH_INFO: `/v3/users/a9e90254520848e78fe887407e0ad539` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:15.758538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e90254520848e78fe887407e0ad539)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:15.760426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:15.806876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e90254520848e78fe887407e0ad539'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:15.807465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e90254520848e78fe887407e0ad539'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:15.815381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e90254520848e78fe887407e0ad539'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:15.816382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e90254520848e78fe887407e0ad539'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:15.823452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e90254520848e78fe887407e0ad539'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:15.843359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1082/2171] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:15 2022] DELETE /identity/v3/users/a9e90254520848e78fe887407e0ad539 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:15.848048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:15.848565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:15.848664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:15.865592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:15.866774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:15.926398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1090/2172] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:15.936702 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:15.938956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:15.993634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0975ffa-b7e6-4b4d-9f03-c34fa439411a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:15.997301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:15.997933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:15.998214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:15.998486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:16.008089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:16.009535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:16.019811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1083/2173] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:16.289317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:16.290719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:16.304523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879885d1-4c3e-4919-b37a-8c4e9e758acf None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:16.309787 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:16.310975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:16.311229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:16.311621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] PATH_INFO: `/v3/projects/31e8a8bbb0d14004b08d4a9135fbb2f0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:16.312757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e8a8bbb0d14004b08d4a9135fbb2f0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:16.314666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:16.365251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e8a8bbb0d14004b08d4a9135fbb2f0', 'request_id': 'req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.370252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e8a8bbb0d14004b08d4a9135fbb2f0', 'request_id': 'req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.377826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e8a8bbb0d14004b08d4a9135fbb2f0', 'request_id': 'req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.388417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] The token cache is being invalidate because project 31e8a8bbb0d14004b08d4a9135fbb2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:16.388701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.389344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.390906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1091/2174] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:16 2022] DELETE /identity/v3/projects/31e8a8bbb0d14004b08d4a9135fbb2f0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:16.395417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:16.404671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2199f3-d113-4133-909f-77edeb3a24ab service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:16.459169 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:16.460015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:16.460295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:16.460568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] PATH_INFO: `/v3/users/63554c2db85f4429a4819b89e5df052f` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:16.461756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63554c2db85f4429a4819b89e5df052f)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:16.463679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:16.506731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63554c2db85f4429a4819b89e5df052f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.507373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63554c2db85f4429a4819b89e5df052f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.515028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63554c2db85f4429a4819b89e5df052f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.515638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63554c2db85f4429a4819b89e5df052f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.522649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-46b07b3d-3be0-4c02-a1b6-103a6da7f223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63554c2db85f4429a4819b89e5df052f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.539170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1084/2175] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:16 2022] DELETE /identity/v3/users/63554c2db85f4429a4819b89e5df052f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:16.795764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:16.797275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:16.810297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ea66-ba2a-48ee-a19d-2bb29c44cf4e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:16.867754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:16.868607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:16.868886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:16.869197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] PATH_INFO: `/v3/projects/934c2a1fc7a14b38997681a9f2a6e725` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:16.870365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] RBAC: Authorizing `identity:delete_project(project_id=934c2a1fc7a14b38997681a9f2a6e725)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:16.872249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:16.922354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934c2a1fc7a14b38997681a9f2a6e725', 'request_id': 'req-e157c342-10e7-418e-9eb5-ddd24c56916b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.929078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934c2a1fc7a14b38997681a9f2a6e725', 'request_id': 'req-e157c342-10e7-418e-9eb5-ddd24c56916b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.937094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934c2a1fc7a14b38997681a9f2a6e725', 'request_id': 'req-e157c342-10e7-418e-9eb5-ddd24c56916b'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.949417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] The token cache is being invalidate because project 934c2a1fc7a14b38997681a9f2a6e725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:16.949704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.950336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e157c342-10e7-418e-9eb5-ddd24c56916b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:16.952063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1092/2176] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:16 2022] DELETE /identity/v3/projects/934c2a1fc7a14b38997681a9f2a6e725 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:16.956988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:16.957493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:16.957604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:16.974822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:16.976033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:17.035950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1085/2177] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:17.043601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.043889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.044185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.064386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:17.065591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:17.073331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1093/2178] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:17.077424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.086953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48418-722c-4d8a-bf8d-099174ba3a19 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.091547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.092202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.092489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.092766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.093565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:17.093872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.096046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.107728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1086/2179] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:17.112516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.121411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71e3f6-75ea-4d98-8317-8ac506b3400e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.127967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.128722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.129123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.129396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.130084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.131943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.158164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1094/2180] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:17.162662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.172540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d217164-a134-4718-ad8d-93a58e59e65a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.226148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.226805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.227087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.227361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.228036 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.229968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.249439 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1087/2181] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:17.254138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.264139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d85e9-a9b1-4f78-83a2-b104398360cf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.269011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.269672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.269949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.270218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.270931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.272479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.282897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1095/2182] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:17.286637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.296306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c68910-faf3-48d5-929c-27e33e759f32 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.301714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.302351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.302632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.302903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.303618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.305219 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b171de-383c-4e60-a0a2-b3ee7943cec1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.315081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1088/2183] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:17.318907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.328211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a33ad7-416c-40b6-9b31-4fae9bce7fbe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.332821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.333701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.333977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.334245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] PATH_INFO: `/v3/projects/537658c23bcc49bf978c71595c1ad159/users/8b1bf9e5dd434398856e766971d6f7c9/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.350055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=537658c23bcc49bf978c71595c1ad159, user_id=8b1bf9e5dd434398856e766971d6f7c9, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.352654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.364941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1096/2184] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:17 2022] PUT /identity/v3/projects/537658c23bcc49bf978c71595c1ad159/users/8b1bf9e5dd434398856e766971d6f7c9/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:17.375583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.375878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.376152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.401484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] MFA Rules not processed for user `8b1bf9e5dd434398856e766971d6f7c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:17.402668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:17.463880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1089/2185] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:17.468216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.530504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92578d30-581c-4d90-a65c-14c1c653d74b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.535753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.536413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.536794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.536963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.537688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.539559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.565392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1097/2186] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:17.569944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.582088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558314fb-ca2d-469d-bb32-ceceb66d1ab0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.642180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.642851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.643137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.643408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.644096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.646051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.665366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1090/2187] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:17.669400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.680308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af6bd2-a0f9-4f85-800c-639429324021 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.685451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.686295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.686575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.686846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.687567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.690090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.704806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1098/2188] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:17.706154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.716558 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b87e1d-91ab-4f08-b9d2-0608085c0d89 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.721391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.722115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.722548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.722802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.724035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.725407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005d782-ae50-4ef0-a0ce-c237f339dc96 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.742366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.744674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1091/2189] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:17.753819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff1afd-b495-4ff1-bb6b-f066cf126273 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.759507 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.760393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.760677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.760955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] PATH_INFO: `/v3/projects/f56d1bbb7b9b42738682d703a596180b/users/581956d670bb4ee9b17ad2f4a3b3f35e/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.777146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56d1bbb7b9b42738682d703a596180b, user_id=581956d670bb4ee9b17ad2f4a3b3f35e, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.779903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.792831 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1099/2190] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:17 2022] PUT /identity/v3/projects/f56d1bbb7b9b42738682d703a596180b/users/581956d670bb4ee9b17ad2f4a3b3f35e/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:17.804507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.804815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.805122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.833635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] MFA Rules not processed for user `581956d670bb4ee9b17ad2f4a3b3f35e`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:17.834967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:17.898086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1092/2191] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:17.902743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:17.962422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ec851-43cf-4705-9212-70d65bcbfffa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:17.967853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:17.968444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:17.968727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:17.968998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:17.969752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:17.971676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:17.996048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1100/2192] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:18.000071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.011499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db092b79-cd55-47e3-9913-43bb9f4bef6f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.066908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.067583 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.067865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.068143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.068836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.070862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.101111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1093/2193] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:17 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:18.102504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.113251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a153b-15f1-4158-86fe-f2bf0da3c260 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.117952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.118602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.118882 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.119157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.119875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.121492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.132662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1101/2194] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:18.137286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.147524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4134-b9b2-41b4-a2b5-468628eb51fb admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.153310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.154250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.154533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.154817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] PATH_INFO: `/v3/projects/7260c5ea96ef4694977237b8002f63e6/users/35c7ed845ec54a2c8b66d85fb7f782e1/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.179649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7260c5ea96ef4694977237b8002f63e6, user_id=35c7ed845ec54a2c8b66d85fb7f782e1, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.182534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.199842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1094/2195] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:18 2022] PUT /identity/v3/projects/7260c5ea96ef4694977237b8002f63e6/users/35c7ed845ec54a2c8b66d85fb7f782e1/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:18.204475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.216243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59224e78-bbe8-4eb4-bc70-fa4dab9b3c98 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.280676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.281378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.281659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.281933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.283263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.284822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de775-6051-40ea-b005-f1c1e960e887 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.294459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1102/2196] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:18.298731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.308898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6abf6a-e6e6-4681-a287-58d3074d0464 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.314234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.315237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.315606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.315951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] PATH_INFO: `/v3/projects/7260c5ea96ef4694977237b8002f63e6/users/35c7ed845ec54a2c8b66d85fb7f782e1/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.318062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7260c5ea96ef4694977237b8002f63e6, user_id=35c7ed845ec54a2c8b66d85fb7f782e1, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.320750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.332093 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1095/2197] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:18 2022] PUT /identity/v3/projects/7260c5ea96ef4694977237b8002f63e6/users/35c7ed845ec54a2c8b66d85fb7f782e1/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:18.342065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.342356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.342637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.370508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] MFA Rules not processed for user `35c7ed845ec54a2c8b66d85fb7f782e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:18.371685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:18.437674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1103/2198] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:18.447708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.450044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:18.511809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5add68-aa42-48a3-a2ad-2fbdf51d060d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.517354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.518102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.518389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.518666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:18.530139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:18.531601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:18.542474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1096/2199] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:18.980911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:18.982345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:18.994516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dedd8-3fdb-4c04-9792-e71c5317ac5a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:18.998099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:18.998728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:18.999005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:18.999275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:19.052775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:19.054216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99831b75-1fa9-48df-980f-c868c12ea941 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:19.062996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1104/2200] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:24.926829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:24.928697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:24.993930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e06b33-f1a7-4475-a5f9-9566601b55cc service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:24.998475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:24.999329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:24.999606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:24.999875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] PATH_INFO: `/v3/users/a80a701c83e841289afb82c7f882902e` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:25.001420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a80a701c83e841289afb82c7f882902e)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:25.003298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:25.051073 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a80a701c83e841289afb82c7f882902e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.051834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a80a701c83e841289afb82c7f882902e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.061269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a80a701c83e841289afb82c7f882902e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.061997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a80a701c83e841289afb82c7f882902e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.068722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a80a701c83e841289afb82c7f882902e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.085338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1097/2201] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:24 2022] DELETE /identity/v3/users/a80a701c83e841289afb82c7f882902e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:25.090032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:25.090466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:25.090691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:25.108990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:25.110210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:25.174431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1105/2202] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:25.184160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:25.185728 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:25.248061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc3b8d-26d0-42e3-abc1-e222d6bff58c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:25.252223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:25.252864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:25.253188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:25.253465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:25.262662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:25.264090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:25.273808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1098/2203] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:12:25.537733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:25.545655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:25.563081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9a383-8575-445a-8589-5e695452f6b0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:25.571358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:25.572940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:25.573315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:25.573541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] PATH_INFO: `/v3/projects/8ec7357f789a4f17a349e898118d1e1e` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:25.575080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec7357f789a4f17a349e898118d1e1e)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:25.579256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:25.643057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec7357f789a4f17a349e898118d1e1e', 'request_id': 'req-681f204d-df50-489a-8057-762e8160f402'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.648778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec7357f789a4f17a349e898118d1e1e', 'request_id': 'req-681f204d-df50-489a-8057-762e8160f402'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.655531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec7357f789a4f17a349e898118d1e1e', 'request_id': 'req-681f204d-df50-489a-8057-762e8160f402'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.666235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] The token cache is being invalidate because project 8ec7357f789a4f17a349e898118d1e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:25.666516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.667127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.668620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1106/2204] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:25 2022] DELETE /identity/v3/projects/8ec7357f789a4f17a349e898118d1e1e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:25.672627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:25.682101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23d406-a585-4a48-b9ba-7764a7e995d2 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:25.736707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:25.737595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:25.737879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:25.738152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] PATH_INFO: `/v3/users/db7ccc033abd4b60ab9c9b6c866d6588` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:25.739372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7ccc033abd4b60ab9c9b6c866d6588)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:25.741299 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:25.790147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7ccc033abd4b60ab9c9b6c866d6588'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.790960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7ccc033abd4b60ab9c9b6c866d6588'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.798194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7ccc033abd4b60ab9c9b6c866d6588'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.799422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7ccc033abd4b60ab9c9b6c866d6588'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.806490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5c4197db-6542-4fd4-b1a2-a1fefbbd5a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7ccc033abd4b60ab9c9b6c866d6588'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:25.827032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1099/2205] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:25 2022] DELETE /identity/v3/users/db7ccc033abd4b60ab9c9b6c866d6588 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:26.144537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.146056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.161310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f204d-df50-489a-8057-762e8160f402 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.215590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.216426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.216706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.216976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] PATH_INFO: `/v3/projects/040130c4dc554d1f80f71ba6b9793516` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.218173 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] RBAC: Authorizing `identity:delete_project(project_id=040130c4dc554d1f80f71ba6b9793516)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.220546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.267471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040130c4dc554d1f80f71ba6b9793516', 'request_id': 'req-deba6111-a71b-403e-b3c3-aac49083994f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.273143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040130c4dc554d1f80f71ba6b9793516', 'request_id': 'req-deba6111-a71b-403e-b3c3-aac49083994f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.280779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040130c4dc554d1f80f71ba6b9793516', 'request_id': 'req-deba6111-a71b-403e-b3c3-aac49083994f'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.292319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] The token cache is being invalidate because project 040130c4dc554d1f80f71ba6b9793516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:26.292804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.293456 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-deba6111-a71b-403e-b3c3-aac49083994f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.294986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1107/2206] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:26 2022] DELETE /identity/v3/projects/040130c4dc554d1f80f71ba6b9793516 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:26.301443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.301946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.302062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.319351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:26.320551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.386882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1100/2207] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:26.400044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.400484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.400765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.419188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:26.420380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.429408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1108/2208] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:26.434329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.443960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f2d3f-df84-4f54-b60b-d67f70871e55 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.448502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.449278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.449561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.449893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.450641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:26.450967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.452655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.467328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1101/2209] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:26.472478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.481421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631d945-0fdf-4061-80c3-6ba07537b03c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.486728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.490946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.491274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.491563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.492265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.494685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.522872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1109/2210] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:26.526249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.538653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe351f-9de8-4082-95e4-8c83f0de7ef7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.595897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.596565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.596843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.597136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.597834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.600031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.622913 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1102/2211] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:26.624321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.640478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b9be6-baea-4e76-81c3-a0fec60ba0c8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.645955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.646617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.646909 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.647169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.647893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.649531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.664223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1110/2212] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:26.665438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.670959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.672704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.675542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda22c-3572-41bf-8a65-26d81e5e1c79 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.680467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.681227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.681576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.681848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.682588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.684205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.685221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec315474-b05f-4571-904a-a53e39ed31bd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.690045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.690884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.691158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.691425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] PATH_INFO: `/v3/users/9636311536284bd786491be9d182159a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.692638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9636311536284bd786491be9d182159a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.694458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1103/2213] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:26.694579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.698550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.708670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08d1b4-8ad6-4e68-9c5e-6f6a23160be8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.713270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.714118 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.714396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.714772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] PATH_INFO: `/v3/projects/e31f359eddeb480889dd4bb77e4e9dc5/users/4ae2b142ed184530b0f147ea307b716d/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.737288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31f359eddeb480889dd4bb77e4e9dc5, user_id=4ae2b142ed184530b0f147ea307b716d, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.739908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7ec3b-355c-417a-9885-37303275ee82 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.744672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9636311536284bd786491be9d182159a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.745388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9636311536284bd786491be9d182159a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.753539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1104/2214] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:26 2022] PUT /identity/v3/projects/e31f359eddeb480889dd4bb77e4e9dc5/users/4ae2b142ed184530b0f147ea307b716d/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:26.760024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9636311536284bd786491be9d182159a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.764666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979087c-94b8-438c-a006-3d8606455579 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.765278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979087c-94b8-438c-a006-3d8606455579 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.765471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979087c-94b8-438c-a006-3d8606455579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.774483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9636311536284bd786491be9d182159a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.775095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c767a992-711f-4fe2-a0e7-3fedd5b4ded3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9636311536284bd786491be9d182159a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:26.788209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1111/2215] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:26 2022] DELETE /identity/v3/users/9636311536284bd786491be9d182159a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:26.792525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940828c-a155-4262-b21e-55d3082df674 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.792947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940828c-a155-4262-b21e-55d3082df674 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.793276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940828c-a155-4262-b21e-55d3082df674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.793623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a979087c-94b8-438c-a006-3d8606455579 None None] MFA Rules not processed for user `4ae2b142ed184530b0f147ea307b716d`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:26.794864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a979087c-94b8-438c-a006-3d8606455579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.812225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3940828c-a155-4262-b21e-55d3082df674 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:26.813562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3940828c-a155-4262-b21e-55d3082df674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.882180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1112/2216] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:26.888475 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1105/2217] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:26.894154 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940828c-a155-4262-b21e-55d3082df674 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.896107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3940828c-a155-4262-b21e-55d3082df674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.897279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979087c-94b8-438c-a006-3d8606455579 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:26.899639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a979087c-94b8-438c-a006-3d8606455579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:26.957841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940828c-a155-4262-b21e-55d3082df674 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.960594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979087c-94b8-438c-a006-3d8606455579 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:26.962039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.962718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.963002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.963282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.965296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:26.965885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:26.966168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:26.966442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:26.973250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.974771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.975424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:26.976836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:26.984876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1113/2218] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:26.985999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1106/2219] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:27.301315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.304533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:27.312625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.316400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:27.331077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f7394-a73c-427a-9cd5-fcccaaca4e7b service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.333291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565e14e-2859-43c2-a5f9-e623096c4d01 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.336765 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.337660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.341693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.342549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.342836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.343111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.344945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:27.354213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.355628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] PATH_INFO: `/v3/projects/ee52cb5c99a64176b601486924ce1f8e` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.358992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee52cb5c99a64176b601486924ce1f8e)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.362345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.417158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.418803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c11d39-b4eb-4765-98c6-7310e361ed00 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.425367 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee52cb5c99a64176b601486924ce1f8e', 'request_id': 'req-c6ac1285-2a44-417b-9850-e1d5a21eddc4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:27.429511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1114/2220] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:27.432843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee52cb5c99a64176b601486924ce1f8e', 'request_id': 'req-c6ac1285-2a44-417b-9850-e1d5a21eddc4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:27.441284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee52cb5c99a64176b601486924ce1f8e', 'request_id': 'req-c6ac1285-2a44-417b-9850-e1d5a21eddc4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:27.452609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] The token cache is being invalidate because project ee52cb5c99a64176b601486924ce1f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:27.452892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:27.453733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c6ac1285-2a44-417b-9850-e1d5a21eddc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:27.456433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1107/2221] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:27 2022] DELETE /identity/v3/projects/ee52cb5c99a64176b601486924ce1f8e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:27.461637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.462132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.462502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.480998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:27.482362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:27.558196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1115/2222] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:27.566349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.566641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.566919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.586920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:27.588305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:27.597574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1108/2223] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:27.601774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.612151 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d00041-5371-4b3e-b427-2c131058f49a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.617873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.618535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.618823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.619098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.619823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:27.620130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.622132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.637263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1116/2224] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:27.638565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.652692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8986f04-984a-4507-a545-82ca1e9a2f50 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.658752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.659409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.659686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.659956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.660750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.662531 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.692514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1109/2225] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:27 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:27.693987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.705868 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada2301-3fa1-4bda-bd13-f344481e1a14 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.771432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.772133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.772421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.772698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.773423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.775327 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.794655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1117/2226] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:27 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:27.799480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.809593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b318-b74b-4a56-963c-ce18f0bc0e08 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.814315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.814967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.815247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.815523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.816244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.817885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.828086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1110/2227] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:27.832414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.842921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113aabc-a21a-4b2f-a30d-3e8f47e4e8c9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.854908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.855605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.855888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.856159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.856942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.858567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bbcee-2be2-4531-a653-257b39d094ce admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.872798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1118/2228] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:27.874002 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:27.884090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5352b5-4ad7-4e79-b6ef-11d9add2148a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:27.888939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:27.889837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.892499 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.892833 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] PATH_INFO: `/v3/projects/eac36abcd8474ed19b80892da49e859c/users/27a8ea834cd34dae9a7183be7bb8add4/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.908335 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac36abcd8474ed19b80892da49e859c, user_id=27a8ea834cd34dae9a7183be7bb8add4, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:27.911017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:27.924602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1111/2229] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:27 2022] PUT /identity/v3/projects/eac36abcd8474ed19b80892da49e859c/users/27a8ea834cd34dae9a7183be7bb8add4/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:27.935669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:27.935949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:27.936227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:27.963454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] MFA Rules not processed for user `27a8ea834cd34dae9a7183be7bb8add4`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:27.964669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:28.034644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1119/2230] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:28.046626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:28.048523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:28.108412 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e325553-9d2d-46be-9c14-a897fdcfd764 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:28.112119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:28.112763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:28.113042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:28.113345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:28.121504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:28.123016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99658cb-5ec4-4695-b03c-91e4dc5b2432 service glance] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:28.132411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1112/2231] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:29.484050 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:29.485460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:29.559398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a58081-b976-49bc-9ca6-cbf87f6cb48c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:29.564404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:29.565289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:29.566773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:29.567056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] PATH_INFO: `/v3/users/8b1bf9e5dd434398856e766971d6f7c9` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:29.568942 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1bf9e5dd434398856e766971d6f7c9)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:29.573371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:29.628401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1bf9e5dd434398856e766971d6f7c9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:29.629045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1bf9e5dd434398856e766971d6f7c9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:29.640908 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1bf9e5dd434398856e766971d6f7c9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:29.649646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1bf9e5dd434398856e766971d6f7c9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:29.650244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1bf9e5dd434398856e766971d6f7c9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:29.665248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1120/2232] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:29 2022] DELETE /identity/v3/users/8b1bf9e5dd434398856e766971d6f7c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:29.669818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:29.670289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:29.670406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:29.687483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:29.688659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:29.747261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1113/2233] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:29.758828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:29.761266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:29.817441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddbe35-301b-48bc-8ac2-6d9ec17c0b35 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:29.821566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:29.822372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:29.822796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:29.823321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:29.833939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:29.835397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:29.845497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1121/2234] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:30.111960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:30.113448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:30.127344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ff0b5-e4d7-40c1-a843-0f4f01ef7284 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:30.132283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:30.133193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:30.133477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:30.133749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] PATH_INFO: `/v3/projects/537658c23bcc49bf978c71595c1ad159` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:30.134945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537658c23bcc49bf978c71595c1ad159)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:30.136846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:30.183263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537658c23bcc49bf978c71595c1ad159', 'request_id': 'req-a1344aee-3882-4ba6-b10b-6952738defb7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.190087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537658c23bcc49bf978c71595c1ad159', 'request_id': 'req-a1344aee-3882-4ba6-b10b-6952738defb7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.196077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537658c23bcc49bf978c71595c1ad159', 'request_id': 'req-a1344aee-3882-4ba6-b10b-6952738defb7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.206916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] The token cache is being invalidate because project 537658c23bcc49bf978c71595c1ad159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:30.207200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.207828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.209438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1114/2235] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:30 2022] DELETE /identity/v3/projects/537658c23bcc49bf978c71595c1ad159 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:30.214741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:30.224842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dc33a-0654-4c3e-b98f-e43a372379fd service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:30.282198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:30.283686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:30.283970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:30.284245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] PATH_INFO: `/v3/users/581956d670bb4ee9b17ad2f4a3b3f35e` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:30.285461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581956d670bb4ee9b17ad2f4a3b3f35e)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:30.287338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:30.331751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581956d670bb4ee9b17ad2f4a3b3f35e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.332393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581956d670bb4ee9b17ad2f4a3b3f35e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.343659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581956d670bb4ee9b17ad2f4a3b3f35e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.352215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581956d670bb4ee9b17ad2f4a3b3f35e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.352985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581956d670bb4ee9b17ad2f4a3b3f35e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.366276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1122/2236] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:30 2022] DELETE /identity/v3/users/581956d670bb4ee9b17ad2f4a3b3f35e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:30.647457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:30.649138 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:30.665963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1344aee-3882-4ba6-b10b-6952738defb7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:30.721662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:30.722506 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:30.722782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:30.723052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] PATH_INFO: `/v3/projects/f56d1bbb7b9b42738682d703a596180b` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:30.724228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56d1bbb7b9b42738682d703a596180b)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:30.726120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:30.771958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56d1bbb7b9b42738682d703a596180b', 'request_id': 'req-a0a68b7b-7d1b-4324-996c-8ea8ed672923'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.781526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56d1bbb7b9b42738682d703a596180b', 'request_id': 'req-a0a68b7b-7d1b-4324-996c-8ea8ed672923'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.790665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56d1bbb7b9b42738682d703a596180b', 'request_id': 'req-a0a68b7b-7d1b-4324-996c-8ea8ed672923'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.801514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] The token cache is being invalidate because project f56d1bbb7b9b42738682d703a596180b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:30.801800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.802454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.803971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1115/2237] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:30 2022] DELETE /identity/v3/projects/f56d1bbb7b9b42738682d703a596180b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:30.807913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:30.809396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:30.822859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9b221-f86b-4e60-a959-a557a973cfb8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:30.881291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:30.882076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:30.882349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:30.882615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] PATH_INFO: `/v3/users/35c7ed845ec54a2c8b66d85fb7f782e1` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:30.883789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c7ed845ec54a2c8b66d85fb7f782e1)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:30.885737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:30.931138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c7ed845ec54a2c8b66d85fb7f782e1'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.931781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c7ed845ec54a2c8b66d85fb7f782e1'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.944364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c7ed845ec54a2c8b66d85fb7f782e1'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.951605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c7ed845ec54a2c8b66d85fb7f782e1'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.952350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-07f937d9-fc20-4c34-9a62-9f4f7444ab05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c7ed845ec54a2c8b66d85fb7f782e1'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:30.964966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1123/2238] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:30 2022] DELETE /identity/v3/users/35c7ed845ec54a2c8b66d85fb7f782e1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:31.237659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.239096 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:31.252809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a68b7b-7d1b-4324-996c-8ea8ed672923 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.312587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.313577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.314401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.314675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] PATH_INFO: `/v3/projects/7260c5ea96ef4694977237b8002f63e6` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.315861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7260c5ea96ef4694977237b8002f63e6)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.317789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.365018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7260c5ea96ef4694977237b8002f63e6', 'request_id': 'req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:31.372409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7260c5ea96ef4694977237b8002f63e6', 'request_id': 'req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:31.380122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7260c5ea96ef4694977237b8002f63e6', 'request_id': 'req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:31.390171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] The token cache is being invalidate because project 7260c5ea96ef4694977237b8002f63e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:31.390453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:31.391103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6a2910c9-a250-4d9e-9b42-1d1fbb9299da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:31.392727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1116/2239] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:31 2022] DELETE /identity/v3/projects/7260c5ea96ef4694977237b8002f63e6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:31.398730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.399016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.399317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.417547 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:31.418654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:31.477266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1124/2240] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:31.487387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.487677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.487957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.506007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:31.507215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:31.514959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1117/2241] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:31.519031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.528479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1883ad-6007-453f-9ede-e318b4476583 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.533592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.534232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.534511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.534782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.535525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:31.535832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.537459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.549014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1125/2242] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:31.553196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.562131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbabac-e6ce-4960-8c8c-5a167c6b0a1f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.566949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.567593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.567855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.568156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.568903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.570955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.596799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1118/2243] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:31.601011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.611396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be1fc0-7262-484c-a2bb-bc11bc5289dd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.670760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.671349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.671624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.671892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.672642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.675237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.697863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1126/2244] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:31.699090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.710748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ce931-b389-45a9-b3ad-6712fd60e03e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.722149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.723212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.723212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.723435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.724257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.725912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.736623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1119/2245] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:31.740537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.750435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d320f-3de4-4df1-a074-455a8cb250a3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.755238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.755883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.756165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.756443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.757190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.758749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f48bd-e72d-48af-84f4-24b5cf29067d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.769250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1127/2246] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:31.773426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.784318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777e2b-69cc-460b-b0da-56d047caabac admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.788967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.789882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.790193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.790464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] PATH_INFO: `/v3/projects/7db1ce9ec3cf47749d75b0ca48b657d4/users/99be7055b8cc42aea4883a45013d53b4/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.804998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db1ce9ec3cf47749d75b0ca48b657d4, user_id=99be7055b8cc42aea4883a45013d53b4, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.807665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:31.820210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1120/2247] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:31 2022] PUT /identity/v3/projects/7db1ce9ec3cf47749d75b0ca48b657d4/users/99be7055b8cc42aea4883a45013d53b4/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:31.832014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.832476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.832631 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.862934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] MFA Rules not processed for user `99be7055b8cc42aea4883a45013d53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:31.866439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:31.928387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1128/2248] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:31.932818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:31.990644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086125a9-6524-4e75-b699-d66d7e715cca admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:31.995235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:31.995875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:31.996152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:31.996424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:31.997134 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:31.998988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.023090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1121/2249] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:31 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:32.027236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.038229 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f20513-5664-460f-b09d-483cbdbe1742 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.090846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.091498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.091778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.092045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.092721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.094624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.113436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1129/2250] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:32 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:32.117375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.128068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674dd42-c8eb-4a3a-bf6c-ebcf8f139bed admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.132634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.133314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.133594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.133864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.134575 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.136145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.146975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1122/2251] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:32.151002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.160609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84114b-828b-44a2-8667-a82e8da08f94 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.165316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.166181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.166457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.166727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] PATH_INFO: `/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9/users/4346eb9f01204fb3ac1e14a1f0df4083/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.180710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afa88468ac7417aad39f11a0d2b9ce9, user_id=4346eb9f01204fb3ac1e14a1f0df4083, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.183266 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.195748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1130/2252] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:32 2022] PUT /identity/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9/users/4346eb9f01204fb3ac1e14a1f0df4083/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:32.199706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.210163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e71107-959d-4c2b-a0b2-f8c76419a4dd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.263065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.263718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.263997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.264265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.264978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.266593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b8042-98e5-46e0-bdd6-102de6788dca admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.276694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1123/2253] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:32.280759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.290558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db79e7-f0c9-4651-aca1-038438145ec5 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.295072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.295920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.296194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.296463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] PATH_INFO: `/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9/users/4346eb9f01204fb3ac1e14a1f0df4083/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.298407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2afa88468ac7417aad39f11a0d2b9ce9, user_id=4346eb9f01204fb3ac1e14a1f0df4083, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.300957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.310719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1131/2254] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:32 2022] PUT /identity/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9/users/4346eb9f01204fb3ac1e14a1f0df4083/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:32.321225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.321511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.321787 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.347730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] MFA Rules not processed for user `4346eb9f01204fb3ac1e14a1f0df4083`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:32.348911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:32.422357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1124/2255] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:32.432251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.433897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:32.488748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9be3-624f-4a92-a4ef-f74c84b3b9fa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.492425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.493111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.493396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.493668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.503263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.504674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0091f-9d87-41c3-b756-9a368c5f8f2a service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.513760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1132/2256] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:32.838356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:32.901596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db0651-435a-4219-a03a-aa23f6111ce9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:32.907127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:32.908548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.908830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.909136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] PATH_INFO: `/v3/users/99be7055b8cc42aea4883a45013d53b4` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:32.910331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99be7055b8cc42aea4883a45013d53b4)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:32.912291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:32.959067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99be7055b8cc42aea4883a45013d53b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:32.959718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99be7055b8cc42aea4883a45013d53b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:32.965857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99be7055b8cc42aea4883a45013d53b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:32.966461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99be7055b8cc42aea4883a45013d53b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:32.973477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99be7055b8cc42aea4883a45013d53b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:32.990025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1125/2257] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:32 2022] DELETE /identity/v3/users/99be7055b8cc42aea4883a45013d53b4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:32.994510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:32.994959 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:32.995083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:33.012195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:33.013384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:33.068843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1133/2258] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:33.078359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:33.079739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:33.134930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b840d-31be-47bc-bb60-38ac64dc61d4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:33.138640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:33.139274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:33.139580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:33.139852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:33.148678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:33.150147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:33.159900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1126/2259] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:33.417170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:33.419020 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:33.431410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b62e43-1960-4af7-a2ce-624d095fa307 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:33.444168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:33.445031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:33.445344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:33.445613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] PATH_INFO: `/v3/projects/7db1ce9ec3cf47749d75b0ca48b657d4` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:33.446842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db1ce9ec3cf47749d75b0ca48b657d4)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:33.448743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:33.495902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db1ce9ec3cf47749d75b0ca48b657d4', 'request_id': 'req-4195b07c-1178-47c2-857a-d8fb1331544d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.501809 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db1ce9ec3cf47749d75b0ca48b657d4', 'request_id': 'req-4195b07c-1178-47c2-857a-d8fb1331544d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.508842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db1ce9ec3cf47749d75b0ca48b657d4', 'request_id': 'req-4195b07c-1178-47c2-857a-d8fb1331544d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.519989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] The token cache is being invalidate because project 7db1ce9ec3cf47749d75b0ca48b657d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:33.520273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.520917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.522488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1134/2260] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:33 2022] DELETE /identity/v3/projects/7db1ce9ec3cf47749d75b0ca48b657d4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:33.526526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:33.536431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008f5c5-b626-4a8d-bbf6-a1e69ff6b5bf service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:33.589392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:33.590278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:33.590554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:33.590825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] PATH_INFO: `/v3/users/4346eb9f01204fb3ac1e14a1f0df4083` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:33.592003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4346eb9f01204fb3ac1e14a1f0df4083)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:33.593923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:33.636237 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4346eb9f01204fb3ac1e14a1f0df4083'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.636870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4346eb9f01204fb3ac1e14a1f0df4083'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.644201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4346eb9f01204fb3ac1e14a1f0df4083'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.645013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4346eb9f01204fb3ac1e14a1f0df4083'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.651631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4c842289-c87c-48c7-8f48-56673b3af292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4346eb9f01204fb3ac1e14a1f0df4083'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:33.668225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1127/2261] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:33 2022] DELETE /identity/v3/users/4346eb9f01204fb3ac1e14a1f0df4083 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:33.930746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:33.932245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:33.945679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b07c-1178-47c2-857a-d8fb1331544d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.013413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.014235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.014511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.014782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] PATH_INFO: `/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.015955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2afa88468ac7417aad39f11a0d2b9ce9)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.017902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.060710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2afa88468ac7417aad39f11a0d2b9ce9', 'request_id': 'req-557978a6-f1bb-4737-85c9-f9f96fcd7796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:34.066475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2afa88468ac7417aad39f11a0d2b9ce9', 'request_id': 'req-557978a6-f1bb-4737-85c9-f9f96fcd7796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:34.072748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2afa88468ac7417aad39f11a0d2b9ce9', 'request_id': 'req-557978a6-f1bb-4737-85c9-f9f96fcd7796'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:34.083080 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] The token cache is being invalidate because project 2afa88468ac7417aad39f11a0d2b9ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:34.083366 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:34.083983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-557978a6-f1bb-4737-85c9-f9f96fcd7796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:34.085511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1135/2262] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:33 2022] DELETE /identity/v3/projects/2afa88468ac7417aad39f11a0d2b9ce9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:34.090516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.090977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.091088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.108267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:34.109490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:34.167199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1128/2263] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:34.175425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.175738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.176015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.194389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:34.195564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:34.203385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1136/2264] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:34.207518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.217153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e616-c222-426a-9a0a-8e8a8e161a09 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.221904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.222549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.222831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.223107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.223820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:34.224126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.225734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.237613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1129/2265] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:34.241727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.250958 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2081af-0a8f-462b-82c8-52cdca72ec0d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.256168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.256799 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.257110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.257390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.258075 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.259969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.286498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1137/2266] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:34.290588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.300663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834d4bd-36ee-4620-94bf-04a6fc39f7f8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.353403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.354051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.354334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.354621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.355305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.357196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.377302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1130/2267] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:34.381376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.391826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c064844-ef57-4512-89da-d7376ae3d863 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.396512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.397197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.397481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.397756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.398475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.400070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.411859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1138/2268] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:34.415591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.425873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec515ad-4de8-4f55-8673-a7adcf1422f8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.430434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.431075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.431357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.431631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.432414 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.434032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dac20-a8e4-48ab-88c3-dbe0316ccfd5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.443730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1131/2269] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:34.447682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.457413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97f850-5d27-4e82-81a8-034fbe8ea355 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.462185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.463053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.463370 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.463605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] PATH_INFO: `/v3/projects/9b13b3df5623439b9c513ee1e73e0ee5/users/033466f5e024459189338e1089bcdc06/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.478726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b13b3df5623439b9c513ee1e73e0ee5, user_id=033466f5e024459189338e1089bcdc06, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.481316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.495411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1139/2270] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:34 2022] PUT /identity/v3/projects/9b13b3df5623439b9c513ee1e73e0ee5/users/033466f5e024459189338e1089bcdc06/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:34.505842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.506129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.506402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.531693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] MFA Rules not processed for user `033466f5e024459189338e1089bcdc06`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:34.533472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:34.600168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1132/2271] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:34.604561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.664715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90567a38-287d-45ec-a518-4264531d2093 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.669441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.670095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.670374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.670648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.671343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.673898 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.697970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1140/2272] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:34.702422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.715177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1afba-5dd9-4d8e-a945-111f2e6b83b8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.774581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.775279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.775564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.775841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.776528 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.778459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.798813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1133/2273] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:34 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:34.802378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.812377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953928-5e66-4d52-b6e2-fa46dc040426 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.817891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.818658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.819027 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.819200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.819954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.821582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.832286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1141/2274] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:34.836334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.846012 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed68cd3-579d-4d89-930d-bbf0b31dbe64 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.855189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.856201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.856372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.856651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] PATH_INFO: `/v3/projects/0e23b287e184496a9e7c4918e31378a3/users/029cb3bcea3b4f53b10d185ff97f7447/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.872557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e23b287e184496a9e7c4918e31378a3, user_id=029cb3bcea3b4f53b10d185ff97f7447, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.875501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.888995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1134/2275] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:34 2022] PUT /identity/v3/projects/0e23b287e184496a9e7c4918e31378a3/users/029cb3bcea3b4f53b10d185ff97f7447/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:34.892943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.902782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b20e3-cf78-4b4e-9ff0-da4db9590f33 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.959931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.960645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.960925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.961235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.961960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.963561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f029d8-ab61-4f12-a247-8f8c93ed1f0c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:34.973312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1142/2276] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:34.977445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:34.989194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d6afa-9547-419a-b3ae-ff7fe8e78f1b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:34.993900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:34.994780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:34.995061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:34.995337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] PATH_INFO: `/v3/projects/0e23b287e184496a9e7c4918e31378a3/users/029cb3bcea3b4f53b10d185ff97f7447/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:34.997329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e23b287e184496a9e7c4918e31378a3, user_id=029cb3bcea3b4f53b10d185ff97f7447, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:34.999906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:35.010954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1135/2277] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:34 2022] PUT /identity/v3/projects/0e23b287e184496a9e7c4918e31378a3/users/029cb3bcea3b4f53b10d185ff97f7447/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:35.021830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:35.022295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:35.022385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:35.047714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] MFA Rules not processed for user `029cb3bcea3b4f53b10d185ff97f7447`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:35.049442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:35.116145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1143/2278] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:35.126404 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:35.128189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:35.184670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecf56d-cce3-40d4-8118-5e4b64352812 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:35.188349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:35.189006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:35.189304 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:35.189579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:35.244719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:35.246172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54b925-b9a5-4e88-9105-623754c8b0dd service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:35.255815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1136/2279] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:46.135379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:46.195135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ea308-ae5b-41dc-96f1-3e55a2b25420 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:46.199685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:46.200539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:46.200817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:46.201123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] PATH_INFO: `/v3/users/033466f5e024459189338e1089bcdc06` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:46.202297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=033466f5e024459189338e1089bcdc06)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:46.204174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:46.248693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033466f5e024459189338e1089bcdc06'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.249476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033466f5e024459189338e1089bcdc06'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.262219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033466f5e024459189338e1089bcdc06'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.269937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033466f5e024459189338e1089bcdc06'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.270675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033466f5e024459189338e1089bcdc06'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.282957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1144/2280] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:46 2022] DELETE /identity/v3/users/033466f5e024459189338e1089bcdc06 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:46.287954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:46.288453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:46.288651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:46.305911 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:46.307099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:46.366305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1137/2281] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:46.376653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:46.378106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:46.433530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022364f-2616-4a5b-9e0f-6627152063ce admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:46.437359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:46.437992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:46.438278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:46.438543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:46.448517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:46.449968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:46.459175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1145/2282] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:12:46.729252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:46.730797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:46.745442 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce331-7d97-420a-ac05-d4af83cb06c0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:46.750590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:46.751441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:46.751721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:46.752116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] PATH_INFO: `/v3/projects/9b13b3df5623439b9c513ee1e73e0ee5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:46.753248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b13b3df5623439b9c513ee1e73e0ee5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:46.755135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:46.800137 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b13b3df5623439b9c513ee1e73e0ee5', 'request_id': 'req-2e93710b-f5c5-4eb6-bac2-2100c4992999'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.806939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b13b3df5623439b9c513ee1e73e0ee5', 'request_id': 'req-2e93710b-f5c5-4eb6-bac2-2100c4992999'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.812857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b13b3df5623439b9c513ee1e73e0ee5', 'request_id': 'req-2e93710b-f5c5-4eb6-bac2-2100c4992999'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.822533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] The token cache is being invalidate because project 9b13b3df5623439b9c513ee1e73e0ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:46.822813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.823422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.824915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1138/2283] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:46 2022] DELETE /identity/v3/projects/9b13b3df5623439b9c513ee1e73e0ee5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:46.828837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:46.838730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a441-17a6-4b83-b693-17fe0b8cc507 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:46.892167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:46.892943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:46.893243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:46.894009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] PATH_INFO: `/v3/users/029cb3bcea3b4f53b10d185ff97f7447` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:46.895174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=029cb3bcea3b4f53b10d185ff97f7447)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:46.897036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:46.938971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029cb3bcea3b4f53b10d185ff97f7447'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.939598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029cb3bcea3b4f53b10d185ff97f7447'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.950788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029cb3bcea3b4f53b10d185ff97f7447'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.958485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029cb3bcea3b4f53b10d185ff97f7447'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.959160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029cb3bcea3b4f53b10d185ff97f7447'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:46.970529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1146/2284] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:46 2022] DELETE /identity/v3/users/029cb3bcea3b4f53b10d185ff97f7447 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:12:47.224601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:47.226061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:47.239841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93710b-f5c5-4eb6-bac2-2100c4992999 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:47.296309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:47.297202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:47.297485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:47.297761 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] PATH_INFO: `/v3/projects/0e23b287e184496a9e7c4918e31378a3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:47.298933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e23b287e184496a9e7c4918e31378a3)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:47.301498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:47.344548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e23b287e184496a9e7c4918e31378a3', 'request_id': 'req-650d1ca6-23d7-4052-9124-474787845d15'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:47.353422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e23b287e184496a9e7c4918e31378a3', 'request_id': 'req-650d1ca6-23d7-4052-9124-474787845d15'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:47.359596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e23b287e184496a9e7c4918e31378a3', 'request_id': 'req-650d1ca6-23d7-4052-9124-474787845d15'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:47.371222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] The token cache is being invalidate because project 0e23b287e184496a9e7c4918e31378a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:47.371503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:47.372163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-650d1ca6-23d7-4052-9124-474787845d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:47.373805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1139/2285] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:47 2022] DELETE /identity/v3/projects/0e23b287e184496a9e7c4918e31378a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:57.782928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:57.784425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:57.798404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14def5-238f-4b7d-b159-be6d0f618c0a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:57.853248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:57.854117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:57.854397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:57.854670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] PATH_INFO: `/v3/users/4ae2b142ed184530b0f147ea307b716d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:57.855845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae2b142ed184530b0f147ea307b716d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:57.857821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:57.906637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae2b142ed184530b0f147ea307b716d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:57.907296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae2b142ed184530b0f147ea307b716d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:57.919711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae2b142ed184530b0f147ea307b716d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:57.927630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae2b142ed184530b0f147ea307b716d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:57.928126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae2b142ed184530b0f147ea307b716d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:57.940060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1147/2286] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:12:57 2022] DELETE /identity/v3/users/4ae2b142ed184530b0f147ea307b716d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:57.944639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396626-78df-4203-b401-024e45f02c8c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:57.945110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396626-78df-4203-b401-024e45f02c8c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:57.945225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35396626-78df-4203-b401-024e45f02c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:57.963677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-35396626-78df-4203-b401-024e45f02c8c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:57.964880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-35396626-78df-4203-b401-024e45f02c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.031325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1140/2287] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:58.038578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.040914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.100851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72620111-e0a4-4ed9-b824-d6b0beac077f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.104473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.105128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.105407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.105676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.114292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.115691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492d47-f5c8-44bc-bead-4ae935e031d2 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.124686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1148/2288] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:12:58.379772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35396626-78df-4203-b401-024e45f02c8c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.381438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-35396626-78df-4203-b401-024e45f02c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.393943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35396626-78df-4203-b401-024e45f02c8c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.400014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.400907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.401236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.401512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] PATH_INFO: `/v3/projects/e31f359eddeb480889dd4bb77e4e9dc5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.402753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31f359eddeb480889dd4bb77e4e9dc5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.404668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.450133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31f359eddeb480889dd4bb77e4e9dc5', 'request_id': 'req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:58.457166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31f359eddeb480889dd4bb77e4e9dc5', 'request_id': 'req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:58.463847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31f359eddeb480889dd4bb77e4e9dc5', 'request_id': 'req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:58.473734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] The token cache is being invalidate because project e31f359eddeb480889dd4bb77e4e9dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:12:58.474020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:58.474648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-24a1dc7f-1fdd-4eb9-a018-f18e127fa58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:12:58.476162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1141/2289] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:12:58 2022] DELETE /identity/v3/projects/e31f359eddeb480889dd4bb77e4e9dc5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:58.481048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.481429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.481763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.498875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:58.500305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.554818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1149/2290] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:58.562458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.562745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.563020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.581485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:58.583266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.590963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1142/2291] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:12:58.595068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.604573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e8e2-ddbe-403f-8827-7b37f1031495 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.609238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.609906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.610187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.610461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.611210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:12:58.611517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.613125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.624438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1150/2292] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:12:58.628595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.637992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90c516-d6b4-48d2-849b-ca474cae8323 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.642537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.643165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.643443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.643716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.644387 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.646305 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.670401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1143/2293] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:12:58 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:12:58.674376 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.684498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e257948-321e-4d7a-8907-5987a7e8ab8e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.737544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.738102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.738398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.739199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.739874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.741761 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.761356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1151/2294] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:12:58 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:12:58.765593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.775646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4501e8-8e47-4ea2-b8a5-d0a73deec2a2 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.780248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.781006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.781217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.781494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.782216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.783780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.795247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1144/2295] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:12:58.799054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.809066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bcfd3-f1ba-4c93-8aa2-548b2967e8aa admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.813609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.814239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.814515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.814782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.815491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.817644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8e64-b3e5-4a01-94e2-17dee17c28c1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.827209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1152/2296] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:12:58.831185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.840666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e31cf0-b114-4398-b8f7-582d72ca3443 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:58.845278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:58.846133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.846413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.846687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] PATH_INFO: `/v3/projects/714d8af8a05440c29850b44f6e7dee4d/users/dcc2ec6229a541febf71f6a000328687/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.860494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714d8af8a05440c29850b44f6e7dee4d, user_id=dcc2ec6229a541febf71f6a000328687, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:58.863110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:58.877818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1145/2297] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:12:58 2022] PUT /identity/v3/projects/714d8af8a05440c29850b44f6e7dee4d/users/dcc2ec6229a541febf71f6a000328687/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:12:58.889389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:58.889674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:58.889949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:58.917363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] MFA Rules not processed for user `dcc2ec6229a541febf71f6a000328687`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:12:58.918560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:58.980227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1153/2298] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:12:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:12:58.990225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:12:58.991864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:12:59.046049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986a55-14d9-4a46-8fab-00c5e4565945 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:12:59.049686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:12:59.050312 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:12:59.050588 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:12:59.050887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:12:59.059547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:12:59.060986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136bcba-34f7-4c5a-b311-fe2528d3f78c service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:12:59.069429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1146/2299] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:12:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:27.997408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:28.097523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbdc3b-c37f-42e6-b1bf-3cd913f1a55a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:28.102559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:28.103416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.103694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.103965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] PATH_INFO: `/v3/users/dcc2ec6229a541febf71f6a000328687` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.105184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc2ec6229a541febf71f6a000328687)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:28.107068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:28.156506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc2ec6229a541febf71f6a000328687'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.157181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc2ec6229a541febf71f6a000328687'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.168070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc2ec6229a541febf71f6a000328687'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.175099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc2ec6229a541febf71f6a000328687'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.175745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc2ec6229a541febf71f6a000328687'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.188000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1154/2300] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:13:27 2022] DELETE /identity/v3/users/dcc2ec6229a541febf71f6a000328687 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:28.192988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.193488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.193580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.247170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:28.248849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:28.311003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1147/2301] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:13:28.320448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:28.321838 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:28.412949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b223-e435-4207-ac6e-6cf908122fe4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:28.416515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:28.417180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.417462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.417736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.426952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:28.428350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65b534-72a7-4e75-a79c-5e9bd674fbfb service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:28.437431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1155/2302] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:28.704983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:28.706482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:28.718627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c318c8-677c-43b8-b9f2-d539fdc61ff2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:28.724328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:28.725226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.725509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.725784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] PATH_INFO: `/v3/projects/714d8af8a05440c29850b44f6e7dee4d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.727123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714d8af8a05440c29850b44f6e7dee4d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:28.729044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:28.774810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714d8af8a05440c29850b44f6e7dee4d', 'request_id': 'req-cbf7d5c3-0ae0-4150-a45a-48504036d461'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.781798 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714d8af8a05440c29850b44f6e7dee4d', 'request_id': 'req-cbf7d5c3-0ae0-4150-a45a-48504036d461'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.788718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714d8af8a05440c29850b44f6e7dee4d', 'request_id': 'req-cbf7d5c3-0ae0-4150-a45a-48504036d461'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.798572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] The token cache is being invalidate because project 714d8af8a05440c29850b44f6e7dee4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:13:28.798854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.799473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cbf7d5c3-0ae0-4150-a45a-48504036d461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:28.800984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1148/2303] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:13:28 2022] DELETE /identity/v3/projects/714d8af8a05440c29850b44f6e7dee4d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:28.805969 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.806253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.806544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.853600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:28.854798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:28.912870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1156/2304] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:28.920855 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.921105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.921390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.939614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:28.940901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:28.949893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1149/2305] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:28.954238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:28.964023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea935f-ed1c-4fb9-8ab8-245541b42132 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:28.968632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:28.969297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:28.969590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:28.969861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:28.970632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:13:28.970872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:28.972433 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:28.983916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1157/2306] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:13:28.988288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:28.997582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b393-7ff8-4b4f-99f8-b35bec3be4ac None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.002943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.003635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.003915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.004753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.005576 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.007585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.034545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1150/2307] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:13:28 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:29.038874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.049610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0796d-4569-4e11-bb30-368395f4d369 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.103116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.103779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.104061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.104337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.105018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.106926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.128453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1158/2308] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:13:29 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:29.132992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.143202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067bb22-f729-49ef-bd29-12ea2d3e2cb4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.148348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.149001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.149309 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.149578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.150294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.151853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.162062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1151/2309] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:29.166040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.175718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152086c-82cd-4772-b87b-c88492205283 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.180231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.189104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.189104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.189104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.189104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.189104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93757c1-a841-4ed8-abc3-82a2a2336cbf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.193952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1159/2310] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:29.198083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.208642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069f08b-7cf3-4268-8ae3-6c0938816839 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.213347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.214287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.214569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.214844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] PATH_INFO: `/v3/projects/560320d91b1040c1a89ebbb3b455cba1/users/b9fb109a1e7d4af1946ee041310d6df2/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.231458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560320d91b1040c1a89ebbb3b455cba1, user_id=b9fb109a1e7d4af1946ee041310d6df2, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.234209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.248154 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1152/2311] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:13:29 2022] PUT /identity/v3/projects/560320d91b1040c1a89ebbb3b455cba1/users/b9fb109a1e7d4af1946ee041310d6df2/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:29.260478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.260760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.261034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.286619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] MFA Rules not processed for user `b9fb109a1e7d4af1946ee041310d6df2`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:29.287785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:29.321087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.322777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:29.350489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1160/2312] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:29.359910 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.361238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:29.386202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee77e78-1a66-4865-822b-e70b2a8baa21 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.390980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.391847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.392126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.392420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] PATH_INFO: `/v3/users/27a8ea834cd34dae9a7183be7bb8add4` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.393665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a8ea834cd34dae9a7183be7bb8add4)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.395637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.416970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79659d60-bd66-427c-a1e5-de7e01e1e062 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.421509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.422272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.422655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.423001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.433311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.434821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c616d-328e-479f-b271-c6b8286ce4cc service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.441105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a8ea834cd34dae9a7183be7bb8add4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:29.442397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a8ea834cd34dae9a7183be7bb8add4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:29.444496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1161/2313] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:13:29.451574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a8ea834cd34dae9a7183be7bb8add4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:29.452297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a8ea834cd34dae9a7183be7bb8add4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:29.459357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a8ea834cd34dae9a7183be7bb8add4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:29.475605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1153/2314] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:13:29 2022] DELETE /identity/v3/users/27a8ea834cd34dae9a7183be7bb8add4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:13:29.480207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.480499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.480773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.497764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:29.498961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:29.557156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1162/2315] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:29.567758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:29.569196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:29.628243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f61cba-9fcd-4c5e-b417-85218f1d92c7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:29.632568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:29.633247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:29.633536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:29.633809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:29.644011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:29.645565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503617c9-ede3-4c9e-8fab-9b7577354c9f service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:29.655705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1154/2316] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:30.148881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.150314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:30.162926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac8bc-7b89-4125-a90b-d66d1fe3e472 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.171315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.172175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.172449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.172715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] PATH_INFO: `/v3/projects/eac36abcd8474ed19b80892da49e859c` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.173931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac36abcd8474ed19b80892da49e859c)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.176652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.224561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac36abcd8474ed19b80892da49e859c', 'request_id': 'req-e6317ac9-ae60-4258-be45-31920397a202'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:30.230816 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac36abcd8474ed19b80892da49e859c', 'request_id': 'req-e6317ac9-ae60-4258-be45-31920397a202'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:30.240580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac36abcd8474ed19b80892da49e859c', 'request_id': 'req-e6317ac9-ae60-4258-be45-31920397a202'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:30.251455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] The token cache is being invalidate because project eac36abcd8474ed19b80892da49e859c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:13:30.251740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:30.252352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e6317ac9-ae60-4258-be45-31920397a202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:30.253904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1163/2317] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:13:30 2022] DELETE /identity/v3/projects/eac36abcd8474ed19b80892da49e859c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:30.259159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.259624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.259729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.276485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:30.277779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:30.332971 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1155/2318] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:30.340877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.341263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.341610 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.359607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:30.360804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:30.369521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1164/2319] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:13:30.373811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.383862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6cac7-9333-45e2-a7ca-b6e741b6109c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.388411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.389047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.389349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.389618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.390328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:13:30.390665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.392212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.403239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1156/2320] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:13:30.407319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.416208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b35af-9ee1-4226-b214-350995aa47bd None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.420729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.421385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.421663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.421933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.422608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.424475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.449917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1165/2321] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:13:30 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:30.453954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.463681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81ae5c-a869-4744-b1fb-95d6b8a8e776 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.517005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.517685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.517964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.518233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.518916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.520808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.541379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1157/2322] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:13:30 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:30.545766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.562413 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f490902-45bc-4dc0-b7c6-0e2b5f368a2f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.568107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.568757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.569035 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.569587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.570307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.571866 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.583364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1166/2323] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:30.587679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.597460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab34df-fa4f-4318-88f2-2756ad66e038 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.602707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.603366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.603652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.603926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.604649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.606266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2263e-6fbc-428b-970c-ad5fb5ab83a0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.617177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1158/2324] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:13:30.621542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.631681 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d33050-7422-42be-ac49-7b425b4de6c4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.636313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.637204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.637478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.637749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] PATH_INFO: `/v3/projects/61c6473192574cb8a0bfd7d97de96b54/users/6f1292c505234fc895271c0bbfa38eff/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.652038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c6473192574cb8a0bfd7d97de96b54, user_id=6f1292c505234fc895271c0bbfa38eff, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.654673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.668091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1167/2325] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:13:30 2022] PUT /identity/v3/projects/61c6473192574cb8a0bfd7d97de96b54/users/6f1292c505234fc895271c0bbfa38eff/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:30.680609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.680899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.681202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.707991 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] MFA Rules not processed for user `6f1292c505234fc895271c0bbfa38eff`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:30.709214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:30.773390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1159/2326] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:30.782750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.784491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:30.843940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d40b-06de-4192-a198-1c2cae7fa6ab admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:30.848871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:30.849557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:30.849839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:30.850162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:30.859709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:30.861212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be558ac1-e398-4172-a07f-3ff66d2077d6 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:30.880059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1168/2327] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:30.935463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:30.937158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.006907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2972c2-bc77-4023-a29a-ede5956b5538 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.011570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.012448 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.012835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.012974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] PATH_INFO: `/v3/users/9dd50092ed9545eaae3727d29fc4e8cb` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.014754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd50092ed9545eaae3727d29fc4e8cb)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.017196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.075989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd50092ed9545eaae3727d29fc4e8cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.076639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd50092ed9545eaae3727d29fc4e8cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.084232 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd50092ed9545eaae3727d29fc4e8cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.084871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd50092ed9545eaae3727d29fc4e8cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.092288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd50092ed9545eaae3727d29fc4e8cb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.111548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1160/2328] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:13:30 2022] DELETE /identity/v3/users/9dd50092ed9545eaae3727d29fc4e8cb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:31.115785 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.116138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.116499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.137033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:31.138330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.206208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1169/2329] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:31.216696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.218231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.284907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff8599-117d-4550-b96f-ca057d36bb2e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.288676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.289375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.289655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.290023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.300743 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.302285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c8c98-c9a0-4daa-849c-76e1fe7b0196 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.311953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1161/2330] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:31.564217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.565659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.578008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b062129-ed7b-452b-9638-7e2896041079 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.582745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.583628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.583935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.584176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] PATH_INFO: `/v3/projects/d7546f6820b84b859304eb8302d72c6a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.585552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7546f6820b84b859304eb8302d72c6a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.587428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.634445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7546f6820b84b859304eb8302d72c6a', 'request_id': 'req-b593063c-f867-46cc-9600-61c8bdc5d542'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.639587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7546f6820b84b859304eb8302d72c6a', 'request_id': 'req-b593063c-f867-46cc-9600-61c8bdc5d542'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.646619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7546f6820b84b859304eb8302d72c6a', 'request_id': 'req-b593063c-f867-46cc-9600-61c8bdc5d542'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.657255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] The token cache is being invalidate because project d7546f6820b84b859304eb8302d72c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:13:31.657536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.658159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b593063c-f867-46cc-9600-61c8bdc5d542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:31.659662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1170/2331] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:13:31 2022] DELETE /identity/v3/projects/d7546f6820b84b859304eb8302d72c6a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:31.664665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.664956 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.665265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.682781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:31.683952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.741290 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1162/2332] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:31.749604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.750200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.750412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.768918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:31.770143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:31.777930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1171/2333] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:31.782176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.791751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb77873-c5b7-4990-8bf7-e6d04affb5e2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.796297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.796952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.797264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.797539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.798251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:13:31.798556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.800115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.811915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1163/2334] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:13:31.816063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.825573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c133a61-36e9-48c3-b6e5-10737ee81d4f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.830408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.831040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.831318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.831590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.832280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.834694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.858778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1172/2335] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:13:31 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:13:31.862807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.872438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24746-af01-4994-846a-016bfa9663c8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.925810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.926469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.926749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.927022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.927710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.930077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.949268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1164/2336] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:13:31 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:31.953399 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.964029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a888d6-498f-47df-8f69-a26238e46427 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:31.969176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:31.970282 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:31.970380 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:31.970700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:31.971430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:31.972994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:31.985169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1173/2337] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:31.987425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:31.997017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021346ef-9a19-44be-9967-c35f3f0816ee admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:32.001905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:32.002546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:32.002828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:32.003104 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:32.003817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:32.005939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa063cd4-49b3-4f84-a639-0ac2be577280 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:32.015471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1165/2338] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:32.019271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:32.029516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23f6e-9f54-481e-b98b-c467819e9d86 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:32.034285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:32.035132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:32.035410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:32.035682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] PATH_INFO: `/v3/projects/80f9a8e599934ceabd6fbd2b96a626ff/users/d708a686ef8f49b69e6143c9edcfb5b4/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:32.049649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80f9a8e599934ceabd6fbd2b96a626ff, user_id=d708a686ef8f49b69e6143c9edcfb5b4, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:32.052293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:32.064672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1174/2339] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:13:32 2022] PUT /identity/v3/projects/80f9a8e599934ceabd6fbd2b96a626ff/users/d708a686ef8f49b69e6143c9edcfb5b4/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:13:32.070386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511413-f9c0-43a3-a405-c740b6e20b1b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:32.070697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511413-f9c0-43a3-a405-c740b6e20b1b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:32.070976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511413-f9c0-43a3-a405-c740b6e20b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:32.088792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ad511413-f9c0-43a3-a405-c740b6e20b1b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:32.090021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ad511413-f9c0-43a3-a405-c740b6e20b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:32.147084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1166/2340] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:32.156524 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:32.158292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:32.212713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3bf9-8468-4d94-a557-49d296356d0d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:32.216391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:32.217030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:32.217334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:32.217606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:32.226925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:32.228346 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39017fca-1ae2-42b4-8057-cfce75c8efbe service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:32.238441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1175/2341] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:36.493839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:36.494358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:36.494669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:36.527545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] MFA Rules not processed for user `6f1292c505234fc895271c0bbfa38eff`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:36.529337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:36.604331 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1167/2342] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:36.714504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:36.716096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:36.716582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:36.757988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] MFA Rules not processed for user `d708a686ef8f49b69e6143c9edcfb5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:36.759198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:36.839886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1176/2343] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:36.844472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:36.855561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1a9da-a0bd-423d-bc09-c30af47cc30b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:36.863021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:36.863698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:36.863978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:36.864872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:36.865630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:36.867697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:36.904680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1168/2344] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:13:36.905933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:36.919599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030aa1c-59d5-4a57-b991-24901295d4bb None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:36.984232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:36.985208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:36.985682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:36.986104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:36.986935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:36.988996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:37.019280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:37.019686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1177/2345] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:13:36 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:13:37.030358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa1113-fae2-4544-8f06-29aa5b0108da admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:37.036147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:37.036944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:37.037393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:37.037660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:37.038461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:37.042975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:37.057633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1169/2346] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:37.061835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:37.073138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8b605-56bf-4643-aaed-ca3865c7a2a1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:37.078042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:37.079038 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:37.079341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:37.079659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] PATH_INFO: `/v3/projects/9cca52fff25344ffbd0819bf1b6ed246/users/8fbc68c6c1914bd890f8808d7eab78e5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:37.102049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cca52fff25344ffbd0819bf1b6ed246, user_id=8fbc68c6c1914bd890f8808d7eab78e5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:37.104815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:37.119616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1178/2347] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:13:37 2022] PUT /identity/v3/projects/9cca52fff25344ffbd0819bf1b6ed246/users/8fbc68c6c1914bd890f8808d7eab78e5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:37.123560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:37.135494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516af65-a478-4b20-b4ce-97304fe9cf4a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:37.204006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:37.204781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:37.205152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:37.205494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:37.206286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:37.208585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be014-e2c3-4381-b2b9-1ae67457f9cb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:37.218477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1170/2348] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:13:37.222651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:37.236662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42e8b7-e066-4921-bb73-fccc3a4a1a27 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:37.241691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:37.242568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:37.242850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:37.243384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] PATH_INFO: `/v3/projects/9cca52fff25344ffbd0819bf1b6ed246/users/8fbc68c6c1914bd890f8808d7eab78e5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:37.245216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cca52fff25344ffbd0819bf1b6ed246, user_id=8fbc68c6c1914bd890f8808d7eab78e5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:37.248042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:37.259912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1179/2349] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:13:37 2022] PUT /identity/v3/projects/9cca52fff25344ffbd0819bf1b6ed246/users/8fbc68c6c1914bd890f8808d7eab78e5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:42.489381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1e4f-4d3e-433b-820e-8afb827b4a40 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:42.490266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1e4f-4d3e-433b-820e-8afb827b4a40 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:42.490552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d1e4f-4d3e-433b-820e-8afb827b4a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:42.528325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ad2d1e4f-4d3e-433b-820e-8afb827b4a40 None None] MFA Rules not processed for user `8fbc68c6c1914bd890f8808d7eab78e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:42.529682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ad2d1e4f-4d3e-433b-820e-8afb827b4a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:42.625502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1171/2350] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:42.633188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:42.635421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:42.782788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babba-61f1-4295-b784-92a524139d63 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:42.789222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:42.789911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:42.790192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:42.790465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:42.869839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:42.878391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:42.896457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1180/2351] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:44.677567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01c32-29f4-423c-94ae-b693926fc192 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:44.678048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01c32-29f4-423c-94ae-b693926fc192 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:44.678206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f01c32-29f4-423c-94ae-b693926fc192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:44.698393 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-15f01c32-29f4-423c-94ae-b693926fc192 None None] MFA Rules not processed for user `d708a686ef8f49b69e6143c9edcfb5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:44.699887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-15f01c32-29f4-423c-94ae-b693926fc192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:44.713577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1172/2352] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:52.055701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:52.057214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:52.131408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965767c-cb04-4e78-a89e-b3a51694c036 service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:52.136807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:52.137714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:52.137995 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:52.139106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] PATH_INFO: `/v3/users/b9fb109a1e7d4af1946ee041310d6df2` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:52.140395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fb109a1e7d4af1946ee041310d6df2)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:52.142554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:52.200539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fb109a1e7d4af1946ee041310d6df2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.201242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fb109a1e7d4af1946ee041310d6df2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.213187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fb109a1e7d4af1946ee041310d6df2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.220621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fb109a1e7d4af1946ee041310d6df2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.222202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fb109a1e7d4af1946ee041310d6df2'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.234805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1181/2353] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:13:52 2022] DELETE /identity/v3/users/b9fb109a1e7d4af1946ee041310d6df2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:13:52.239491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:52.240024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:52.240024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:52.258187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:13:52.259363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:52.324646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1173/2354] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:13:52.336740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:52.338654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:52.399444 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990eb85-ce0f-489c-b1c2-af1c84a0d023 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:52.408632 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:52.409325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:52.409605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:52.409881 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:52.419895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:52.421352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:52.431348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1182/2355] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:13:52.735083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:13:52.736548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:13:52.750273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0622346-17c0-4ce5-a342-d57a6c7809d6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:13:52.756756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:13:52.757465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:13:52.758098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:13:52.758098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] PATH_INFO: `/v3/projects/560320d91b1040c1a89ebbb3b455cba1` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:13:52.759128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560320d91b1040c1a89ebbb3b455cba1)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:13:52.761172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:13:52.842569 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560320d91b1040c1a89ebbb3b455cba1', 'request_id': 'req-427abb54-2292-4d94-9c95-bb0313a949c9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.850751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560320d91b1040c1a89ebbb3b455cba1', 'request_id': 'req-427abb54-2292-4d94-9c95-bb0313a949c9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.858721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560320d91b1040c1a89ebbb3b455cba1', 'request_id': 'req-427abb54-2292-4d94-9c95-bb0313a949c9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.871581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] The token cache is being invalidate because project 560320d91b1040c1a89ebbb3b455cba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:13:52.871871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.872688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-427abb54-2292-4d94-9c95-bb0313a949c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:13:52.875001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1174/2356] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:13:52 2022] DELETE /identity/v3/projects/560320d91b1040c1a89ebbb3b455cba1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:00.274301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:00.275781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:00.363489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbf77-8d8e-47ab-a92e-9f0a2198fbd1 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:00.420680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:00.421342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:00.421625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:00.421913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:00.423659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:00.434609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:00.436158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:00.446096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1183/2357] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:01.354926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6308-e2d8-43bd-aab9-e85d62b7c266 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:01.355383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6308-e2d8-43bd-aab9-e85d62b7c266 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:01.355494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6308-e2d8-43bd-aab9-e85d62b7c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:01.383850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0f0e6308-e2d8-43bd-aab9-e85d62b7c266 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:01.385019 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0f0e6308-e2d8-43bd-aab9-e85d62b7c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:01.436511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1175/2358] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:14:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:01.477715 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:01.479127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:01.544446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cb9e4-84df-43f9-b28b-fb964336a7fa service placement] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:01.549453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:01.550086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:01.550363 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:01.550637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:01.559107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:01.560673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:01.568391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1184/2359] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:14:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:14:02.078618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2116-6717-42f9-9190-d4217598620a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.078908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2116-6717-42f9-9190-d4217598620a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.079202 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2116-6717-42f9-9190-d4217598620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.097433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0c4e2116-6717-42f9-9190-d4217598620a None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:02.098651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0c4e2116-6717-42f9-9190-d4217598620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:02.105808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1176/2360] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:02.118588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:02.130153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc2dd-07a4-4f5e-86fd-4ffbdbe185c4 service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:02.135459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:02.136249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.136531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.136794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.145889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:02.147437 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:02.158201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1185/2361] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:14:02.380048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0e03-51c4-40cd-89e2-0a9ae301835b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.380513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0e03-51c4-40cd-89e2-0a9ae301835b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.380645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b0e03-51c4-40cd-89e2-0a9ae301835b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.427230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-3c3b0e03-51c4-40cd-89e2-0a9ae301835b None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:02.428422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3c3b0e03-51c4-40cd-89e2-0a9ae301835b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:02.444253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1177/2362] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:02.455963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:02.476291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecdb37-b3a6-4a72-bb50-7da54959b8ae service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:02.481895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:02.482811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.483205 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.483655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.494448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:02.496001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:02.504036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1186/2363] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:14:02.836084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.836517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.836863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.854700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:02.855960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:02.863255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1178/2364] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:14:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:02.876116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:02.886710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cb7f8-1d01-4732-b87c-7cf5fd19dccc service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:02.891878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:02.892504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:02.892821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:02.893186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:02.902064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:02.903718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109a98a-66a0-46d9-a6de-c4608dce3dea service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:02.912658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1187/2365] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:14:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:14:04.940681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:04.942077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.003957 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694ac3f-06a9-4f21-8de6-f382b7ece8f8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.008967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.009873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.010176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.010449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] PATH_INFO: `/v3/users/6f1292c505234fc895271c0bbfa38eff` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.011660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1292c505234fc895271c0bbfa38eff)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.013574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.057756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1292c505234fc895271c0bbfa38eff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.058392 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1292c505234fc895271c0bbfa38eff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.065394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1292c505234fc895271c0bbfa38eff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.065997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1292c505234fc895271c0bbfa38eff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.073334 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1292c505234fc895271c0bbfa38eff'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.090446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1179/2366] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:14:04 2022] DELETE /identity/v3/users/6f1292c505234fc895271c0bbfa38eff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:05.095047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.095466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.095574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.113001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:05.114802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.169980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1188/2367] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:14:05.180343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.181693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.234834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c19b-8d6e-4183-aab1-b0f0d8ba0bc3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.238502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.239724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.240122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.240606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.249733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.251563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547ef57-3b74-4b7e-9e27-b5aa8e67d8e6 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.260894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1180/2368] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:05.427084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.428491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.440365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a50294-865e-4534-b75c-1623b88139e7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.445130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.446012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.446293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.446564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] PATH_INFO: `/v3/projects/61c6473192574cb8a0bfd7d97de96b54` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.447803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c6473192574cb8a0bfd7d97de96b54)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.449843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.494593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c6473192574cb8a0bfd7d97de96b54', 'request_id': 'req-fac8576c-8dc2-49e1-92c3-0b6b5f551793'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.499924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c6473192574cb8a0bfd7d97de96b54', 'request_id': 'req-fac8576c-8dc2-49e1-92c3-0b6b5f551793'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.507713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c6473192574cb8a0bfd7d97de96b54', 'request_id': 'req-fac8576c-8dc2-49e1-92c3-0b6b5f551793'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.518176 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] The token cache is being invalidate because project 61c6473192574cb8a0bfd7d97de96b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:14:05.518458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.519062 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-fac8576c-8dc2-49e1-92c3-0b6b5f551793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:05.521117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1189/2369] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:14:05 2022] DELETE /identity/v3/projects/61c6473192574cb8a0bfd7d97de96b54 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:05.526014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.526298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.526595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.544052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:05.545257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.602592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1181/2370] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:05.610893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.611228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.611486 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.629955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:05.631155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:05.638936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1190/2371] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:05.642893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.652927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e2893-bbb1-47fe-a339-8f449576eee0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.657421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.658054 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.658329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.658599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.659308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:14:05.659608 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.661755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.672989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1182/2372] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:14:05.676992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.686709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a627-6fd8-4c70-aa73-f0476442b645 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.693066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.693747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.694024 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.694294 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.694974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.696843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.721987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1191/2373] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:05.726097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.735973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14808c3c-5d65-48e0-815e-28c9b4f8a147 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.791049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.792018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.792518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.792944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.793816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.795951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.816983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1183/2374] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:14:05.821637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.831702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6cfec-0eb3-4260-939e-b99e7d409bea admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.836988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.837675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.837945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.838215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.838929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.840714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.852487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1192/2375] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:05.856410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.866172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8720225-4709-4706-abf8-4314af27e64e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.870970 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.871623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.871904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.872181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.872926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.874789 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3123-3b35-4831-9b2c-1e73bdba52b7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.885863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1184/2376] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:05.890387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:05.907234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4265f-7bbc-4106-aa73-eb5fbbe2266a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:05.912566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:05.913464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.913852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.914127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] PATH_INFO: `/v3/projects/b0c470aef15d45a0bed2b2d51870ab7c/users/f5ed59d6ca96458ca507a398d0a36bb3/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.928211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c470aef15d45a0bed2b2d51870ab7c, user_id=f5ed59d6ca96458ca507a398d0a36bb3, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:05.930842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:05.943615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1193/2377] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:05 2022] PUT /identity/v3/projects/b0c470aef15d45a0bed2b2d51870ab7c/users/f5ed59d6ca96458ca507a398d0a36bb3/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:05.948683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cca83-66fa-4b89-843e-5ac246c665a7 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:05.949179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cca83-66fa-4b89-843e-5ac246c665a7 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:05.949327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cca83-66fa-4b89-843e-5ac246c665a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:05.968458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-491cca83-66fa-4b89-843e-5ac246c665a7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:05.970165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-491cca83-66fa-4b89-843e-5ac246c665a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:06.026147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1185/2378] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:06.035576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:06.037273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:06.091067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99029a7d-b91b-4b20-9f97-8cdc19542eb3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:06.095416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:06.095885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:06.095885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:06.096141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:06.105233 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:06.106663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:06.116252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1194/2379] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:10.559449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:10.559915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:10.561339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:10.588563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] MFA Rules not processed for user `f5ed59d6ca96458ca507a398d0a36bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:10.589805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:10.654858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1186/2380] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:10.659578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:10.670791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a052d-3da7-4991-8e08-7b1029351df1 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:10.676677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:10.677704 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:10.678185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:10.678445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:10.679311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:10.681436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:10.710067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1195/2381] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:14:10 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:10.714267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:10.726131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce830c-cff4-43d7-9e71-07caef9b9edb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:10.784086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:10.784747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:10.785035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:10.785526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:10.786828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:10.788831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:10.811011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1187/2382] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:14:10 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:14:10.818948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:10.832066 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61df27-cd47-49f8-afd4-e30ae6abb01e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:10.839537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:10.840211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:10.840493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:10.840814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:10.841575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:10.843150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:10.854498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1196/2383] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:10.858832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:10.870123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd028-6ffd-49da-97a5-65160e325b0c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:10.875740 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:10.876729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:10.877120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:10.877492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] PATH_INFO: `/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25/users/7ae59e0f102e43c68648a16f8289bc4d/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:10.898285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0198dd2e14f3465ebd1ddcd1ff587b25, user_id=7ae59e0f102e43c68648a16f8289bc4d, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:10.901389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:10.923323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1188/2384] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:10 2022] PUT /identity/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25/users/7ae59e0f102e43c68648a16f8289bc4d/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:10.925124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:10.939455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12117e-35ea-429c-ba7c-5a0a8efc6730 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:11.011759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:11.012421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:11.012701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:11.012972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:11.013732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:11.015930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a022a-953e-4e6a-8cf8-4736db7c3b9d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:11.029085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1197/2385] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:11.031570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:11.043917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d13b58-b739-4421-88b2-6ea7e6be7535 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:11.049300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:11.050199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:11.050489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:11.051078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] PATH_INFO: `/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25/users/7ae59e0f102e43c68648a16f8289bc4d/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:11.053813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0198dd2e14f3465ebd1ddcd1ff587b25, user_id=7ae59e0f102e43c68648a16f8289bc4d, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:11.062191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:11.078141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1189/2386] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:11 2022] PUT /identity/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25/users/7ae59e0f102e43c68648a16f8289bc4d/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:18.786705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:18.787716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:18.788148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:18.860118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] MFA Rules not processed for user `7ae59e0f102e43c68648a16f8289bc4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:18.861372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:18.993242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1198/2387] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:19.004001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:19.006353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:19.076608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:19.078121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:19.108344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a81bd-45fb-43f4-91cf-21320e15b8fa admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:19.114750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:19.115479 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.115813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.116097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.163510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7fd9-ffef-4353-ba51-400f8bb83448 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:19.168529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:19.170098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.170241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.170548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] PATH_INFO: `/v3/users/193d9e5225e6463ab359f019179c96fc` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.172935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193d9e5225e6463ab359f019179c96fc)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:19.175543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:19.185005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:19.186780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:19.198640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1190/2388] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:19.245374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193d9e5225e6463ab359f019179c96fc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.245919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193d9e5225e6463ab359f019179c96fc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.260899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193d9e5225e6463ab359f019179c96fc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.273489 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193d9e5225e6463ab359f019179c96fc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.274250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f2cac3ac-ab7f-4702-bac6-9be2ad5b8386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193d9e5225e6463ab359f019179c96fc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.291311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1199/2389] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:14:19 2022] DELETE /identity/v3/users/193d9e5225e6463ab359f019179c96fc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:19.531538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:19.550294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e3321-6332-4ef5-8496-99a351690b19 service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:19.660045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:19.667653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.668463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.668463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] PATH_INFO: `/v3/projects/cc3fac73df654ae38575bcda41bd7514` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.670458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3fac73df654ae38575bcda41bd7514)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:19.672547 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:19.736745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3fac73df654ae38575bcda41bd7514', 'request_id': 'req-d7834b29-d77c-48c6-bcf0-fbd33501e635'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.751120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3fac73df654ae38575bcda41bd7514', 'request_id': 'req-d7834b29-d77c-48c6-bcf0-fbd33501e635'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.760341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3fac73df654ae38575bcda41bd7514', 'request_id': 'req-d7834b29-d77c-48c6-bcf0-fbd33501e635'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.776160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] The token cache is being invalidate because project cc3fac73df654ae38575bcda41bd7514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:14:19.776461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.777233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d7834b29-d77c-48c6-bcf0-fbd33501e635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:14:19.779128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1191/2390] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:14:19 2022] DELETE /identity/v3/projects/cc3fac73df654ae38575bcda41bd7514 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:19.783824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.784183 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.784533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.805135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:19.807774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:19.892562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1200/2391] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:19.901106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.901429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.901684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.924230 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:19.925502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:19.939793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1192/2392] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:19.940372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:19.951622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6e1bd-104c-4f25-80f2-ef53f292bb86 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:19.958774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:19.959956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:19.960414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:19.960851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:19.962300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:14:19.962783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:19.964554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:19.978074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1201/2393] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:14:19.982577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:19.992422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2aa06-254d-4b97-a1f8-c9f144e37fec None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:19.999072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.000005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.000292 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.000570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.001294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.003197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.034968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1193/2394] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:14:19 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:20.036215 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.049071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb7ed-79f5-4a76-936c-2add27213b10 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.143398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.144206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.144701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.145195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.146118 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.148412 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.179500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1202/2395] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:14:20 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:20.183405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.197744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc6005-e6d1-4231-abe9-8cc0d581b985 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.213472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.214358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.214760 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.215288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.216272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.218368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.241280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1194/2396] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:20.241978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.256067 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b436118-4b7a-4178-aa07-1f76fe78c8fe admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.262915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.263751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.264144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.265087 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.266260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.268192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a034f8-6d1c-452e-8a29-3164b014f3f5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.282876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1203/2397] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:20.287401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.300153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc207-fb84-4f35-bf2e-72b15a4a4411 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.308165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.309165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.309697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.310418 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] PATH_INFO: `/v3/projects/1a0bc8576c7945cebb8b6b1185faaf2d/users/7f04f8cd200a4ec2a682eb53363e49da/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.329512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0bc8576c7945cebb8b6b1185faaf2d, user_id=7f04f8cd200a4ec2a682eb53363e49da, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.333883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.358741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1195/2398] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:20 2022] PUT /identity/v3/projects/1a0bc8576c7945cebb8b6b1185faaf2d/users/7f04f8cd200a4ec2a682eb53363e49da/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:20.369168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.369454 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.369728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.429018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] MFA Rules not processed for user `7f04f8cd200a4ec2a682eb53363e49da`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:20.430289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:20.530745 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1204/2399] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:14:20.535155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.639646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bf669-a260-42aa-9185-acddacbab1fd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.650738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.651520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.651868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.652258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.653306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.655634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.692949 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1196/2400] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:14:20 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:20.697788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.713041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fc14-e4e2-47da-badd-9d803e6e5d06 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.795590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.796329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.796608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.796877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.798301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.801590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.826139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1205/2401] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:14:20 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:14:20.829815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.844621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b318c-b611-46bb-a8a6-22b5f2c67229 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.852051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.852774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.853009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.853345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.854042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.855635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.869295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1197/2402] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:20.873689 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:20.897982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61f863-40bb-4dbf-9551-dd1c59fd0381 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:20.923371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:20.925767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:20.925767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:20.925767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] PATH_INFO: `/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91/users/db76d3ab3396452faf7c1a922602ae1a/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:20.963191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eac0d86eecd4b0dbd163b6fe68f6c91, user_id=db76d3ab3396452faf7c1a922602ae1a, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:20.966397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:20.985781 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1206/2403] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:20 2022] PUT /identity/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91/users/db76d3ab3396452faf7c1a922602ae1a/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:20.989861 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:21.000497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8a25d-2087-4937-894e-ccc35facb472 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:21.087777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:21.093524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:21.094675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:21.095132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:21.095919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:21.097568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c1907-6afa-453a-be65-b040865e62eb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:21.117681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1198/2404] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:14:21.121675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:21.134171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5622e8-c79e-4596-a82e-208a97a5fcf4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:21.148985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:21.149932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:21.150219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:21.150496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] PATH_INFO: `/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91/users/db76d3ab3396452faf7c1a922602ae1a/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:21.156558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eac0d86eecd4b0dbd163b6fe68f6c91, user_id=db76d3ab3396452faf7c1a922602ae1a, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:21.160104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:21.180670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1207/2405] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:14:21 2022] PUT /identity/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91/users/db76d3ab3396452faf7c1a922602ae1a/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:14:21.191519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:21.192023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:21.192450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:21.226969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] MFA Rules not processed for user `db76d3ab3396452faf7c1a922602ae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:21.228190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:21.301126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1199/2406] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:14:21.312016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:21.313829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:21.400597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e55b7f-9c25-4bf5-bf82-bc62f028a868 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:21.407008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:21.407957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:21.407957 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:21.412310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:21.423967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:21.425567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:21.441343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1208/2407] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:14:21.538289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:21.555359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087301e1-16d9-4395-91a3-df30902bb8a9 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:21.561723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:21.562397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:21.562683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:21.563221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:21.674364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:21.675967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e042063-c766-4eb1-bc91-02ba4424733c service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:21.697032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1200/2408] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:37.836606 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:14:37.838660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:37.892724 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d09143-a9c9-4fa6-89da-0d92a75f0622 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:14:37.896317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:14:37.896970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:37.897287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:37.897560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:37.899904 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:37.960629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:14:37.962770 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f1e12-8bf8-4728-853b-3623c41fbabe service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:14:37.971915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1209/2409] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:14:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:14:47.916729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:14:47.917314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:14:47.917419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:14:47.934375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] MFA Rules not processed for user `f5ed59d6ca96458ca507a398d0a36bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:14:47.935571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:14:47.988823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1201/2410] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:14:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:08.513238 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:08.513765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:08.513859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:08.531967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:08.533623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:08.589550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1210/2411] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:08.636019 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:08.637434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:08.717931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21639f69-c2b0-4d77-9d20-02c03932e9f5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:08.722822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:08.723456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:08.723733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:08.724003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:08.732165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:08.733751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44918ac-c294-4ea4-9aed-59a0ddd305a5 service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:08.742922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1202/2412] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:15:11.253322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:11.370734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0342c9-98a6-4135-8b2a-9e3725f29663 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:11.376207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:11.377158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:11.377446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:11.377751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] PATH_INFO: `/v3/users/7f04f8cd200a4ec2a682eb53363e49da` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:11.379028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f04f8cd200a4ec2a682eb53363e49da)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:11.389169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:11.459905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f04f8cd200a4ec2a682eb53363e49da'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:11.460979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f04f8cd200a4ec2a682eb53363e49da'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:11.502286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f04f8cd200a4ec2a682eb53363e49da'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:11.512143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f04f8cd200a4ec2a682eb53363e49da'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:11.512775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f04f8cd200a4ec2a682eb53363e49da'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:11.527795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1211/2413] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:11 2022] DELETE /identity/v3/users/7f04f8cd200a4ec2a682eb53363e49da => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:11.532490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4227f-1817-4625-a903-48697d437aeb None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:11.532883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4227f-1817-4625-a903-48697d437aeb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:11.532968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4227f-1817-4625-a903-48697d437aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:11.557844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-78b4227f-1817-4625-a903-48697d437aeb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:11.559369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-78b4227f-1817-4625-a903-48697d437aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:11.630522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1203/2414] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:11.643879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:11.645889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:11.721236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318d4c8-cb6b-4f25-aff5-d26c022bfc1a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:11.725351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:11.726670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:11.726954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:11.727228 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:11.738591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:11.740056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:11.755002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1212/2415] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:12.184055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4227f-1817-4625-a903-48697d437aeb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:12.185606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-78b4227f-1817-4625-a903-48697d437aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:12.199965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4227f-1817-4625-a903-48697d437aeb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:12.206300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:12.207530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:12.209241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:12.209684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] PATH_INFO: `/v3/projects/1a0bc8576c7945cebb8b6b1185faaf2d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:12.212456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0bc8576c7945cebb8b6b1185faaf2d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:12.215568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:12.275013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0bc8576c7945cebb8b6b1185faaf2d', 'request_id': 'req-7ddfcc2e-792f-4607-81df-d2554bac5510'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.284669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0bc8576c7945cebb8b6b1185faaf2d', 'request_id': 'req-7ddfcc2e-792f-4607-81df-d2554bac5510'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.292315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0bc8576c7945cebb8b6b1185faaf2d', 'request_id': 'req-7ddfcc2e-792f-4607-81df-d2554bac5510'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.303676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] The token cache is being invalidate because project 1a0bc8576c7945cebb8b6b1185faaf2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:12.303961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.305244 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.309690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1204/2416] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:12 2022] DELETE /identity/v3/projects/1a0bc8576c7945cebb8b6b1185faaf2d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:12.310867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:12.324033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee0ce5-22e9-4306-b425-43637276cb2f service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:12.386649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:12.387509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:12.387786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:12.388059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] PATH_INFO: `/v3/users/db76d3ab3396452faf7c1a922602ae1a` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:12.389260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db76d3ab3396452faf7c1a922602ae1a)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:12.391428 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:12.448420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db76d3ab3396452faf7c1a922602ae1a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.448960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db76d3ab3396452faf7c1a922602ae1a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.462095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db76d3ab3396452faf7c1a922602ae1a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.470872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db76d3ab3396452faf7c1a922602ae1a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.472534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-561ca918-d5b4-4e92-9af4-ae93cb015f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db76d3ab3396452faf7c1a922602ae1a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:12.486084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1213/2417] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:12 2022] DELETE /identity/v3/users/db76d3ab3396452faf7c1a922602ae1a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:12.827686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:12.829145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:12.848963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfcc2e-792f-4607-81df-d2554bac5510 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:12.931752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:12.932620 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:12.932901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:12.933214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] PATH_INFO: `/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:12.934657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eac0d86eecd4b0dbd163b6fe68f6c91)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:12.937303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:12.992938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eac0d86eecd4b0dbd163b6fe68f6c91', 'request_id': 'req-3d9029ad-831e-4db5-b93f-d6c0ac93150a'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:13.001087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eac0d86eecd4b0dbd163b6fe68f6c91', 'request_id': 'req-3d9029ad-831e-4db5-b93f-d6c0ac93150a'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:13.008176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eac0d86eecd4b0dbd163b6fe68f6c91', 'request_id': 'req-3d9029ad-831e-4db5-b93f-d6c0ac93150a'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:13.018897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] The token cache is being invalidate because project 6eac0d86eecd4b0dbd163b6fe68f6c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:13.019177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:13.019828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-3d9029ad-831e-4db5-b93f-d6c0ac93150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:13.021518 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1205/2418] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:12 2022] DELETE /identity/v3/projects/6eac0d86eecd4b0dbd163b6fe68f6c91 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:13.027177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.027469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.027741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.047482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:13.049529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:13.158889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1214/2419] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:13.168269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.168551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.168830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.189591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:13.190800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:13.212591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.213180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1206/2420] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:13.231884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d8e0e-bb56-41f8-8762-2ad04b5c050a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.239709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.240699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.241297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.242760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.243989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:13.244331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.247962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.271592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1215/2421] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:13.273812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.290156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbecd9-742f-4eca-99bd-bfab433c4ad4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.299000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.299909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.300289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.301189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.301994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.311421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.347568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1207/2422] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:13.354113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.381349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3f52e-779b-4f7c-aa67-ba25bca02eff admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.503400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.505749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.506392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.506817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.508160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.510258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.557484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1216/2423] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:13.561864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.573687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e6e51-70fc-4397-8865-98aa9498dec1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.579115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.579866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.580222 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.580544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.581601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.583243 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.598429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1208/2424] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:13.603391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.618815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef88f53-c199-4b63-b617-214410e69de1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.624651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.625356 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.625634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.625903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.626630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.628210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720b896-2490-4600-89fe-c5a4f6208472 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.641104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1217/2425] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:15:13.644216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.660256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7fb6f-9601-4e54-9dbc-3003796fbf08 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.668530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.670278 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.670663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.671076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] PATH_INFO: `/v3/projects/781a6accb074455f85acd04a53f404eb/users/6cd6f1f510a549eba3c23dfe41b8db97/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.691125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781a6accb074455f85acd04a53f404eb, user_id=6cd6f1f510a549eba3c23dfe41b8db97, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.694849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:13.717276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1209/2426] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:13 2022] PUT /identity/v3/projects/781a6accb074455f85acd04a53f404eb/users/6cd6f1f510a549eba3c23dfe41b8db97/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:13.725487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.726239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.728009 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.761620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] MFA Rules not processed for user `6cd6f1f510a549eba3c23dfe41b8db97`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:13.763236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:13.858740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1218/2427] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:13.869505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:13.969234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4624b-d89e-4a70-81c2-903d3ff98449 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:13.974737 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:13.975613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:13.975892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:13.976175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:13.976962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:13.978872 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.020929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1210/2428] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:13 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:14.025528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.040981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfd6df-1dbb-4aa9-9ea5-f51fe4f75458 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.118693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.119359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.119637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.119906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.120582 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.122511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.148878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1219/2429] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:14 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:14.152532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.163834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9413-4211-4f11-ad61-1f446e0853a9 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.174909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.175661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.176006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.176346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.177166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.180037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.194682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1211/2430] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:15:14.197107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.208756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df6701-2315-4a11-8d6f-793780180392 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.214311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.215274 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.215561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.215840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] PATH_INFO: `/v3/projects/aa16c5505768410abafca5ffcafa2204/users/86ed9c512d8c424184d04f6051dd3fc5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.231227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa16c5505768410abafca5ffcafa2204, user_id=86ed9c512d8c424184d04f6051dd3fc5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.234055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.250070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1220/2431] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:14 2022] PUT /identity/v3/projects/aa16c5505768410abafca5ffcafa2204/users/86ed9c512d8c424184d04f6051dd3fc5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:14.254221 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.265449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8ff72-cd96-4edd-bc24-1b2c6c96c56d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.337152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.337918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.338282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.338623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.339492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.341084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd494c74-59aa-40d2-8cb9-294d413664a8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.353361 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1212/2432] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:14.357732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.370046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d376e-451b-4ad1-b5e7-47ff1d4f3fd7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.375400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.376289 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.376567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.376841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] PATH_INFO: `/v3/projects/aa16c5505768410abafca5ffcafa2204/users/86ed9c512d8c424184d04f6051dd3fc5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.379159 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa16c5505768410abafca5ffcafa2204, user_id=86ed9c512d8c424184d04f6051dd3fc5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.382280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.405643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1221/2433] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:14 2022] PUT /identity/v3/projects/aa16c5505768410abafca5ffcafa2204/users/86ed9c512d8c424184d04f6051dd3fc5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:14.407890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.408366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.409035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.522889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] MFA Rules not processed for user `86ed9c512d8c424184d04f6051dd3fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:14.524286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:14.641190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1213/2434] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:14.652775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:14.654577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:14.731975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439897d-abff-4178-a5cd-122f4dae22d3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:14.735601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:14.736253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:14.736567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:14.736874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:14.746471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:14.747900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:14.758434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1222/2435] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:15.135612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:15.145739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3629a-e83a-4ebf-a359-19256a14c998 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:15.156945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86ed9c512d8c424184d04f6051dd3fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa16c5505768410abafca5ffcafa2204', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:15.158130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:15.158413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:15.158795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:15.159775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:15.160069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:15.161963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:15.177923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1214/2436] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:15.184468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:15.199608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7c29-f604-4c36-a8d4-00bfa37eae9f service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:15.205321 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86ed9c512d8c424184d04f6051dd3fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa16c5505768410abafca5ffcafa2204', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:15.205971 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:15.206252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:15.206864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:15.207588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:15.209802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:15.273157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1223/2437] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:15 2022] POST /identity/v3/projects => generated 353 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:15.277623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:15.288884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d85c0-b21e-41ec-838f-9ec77e0039e1 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:15.362463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86ed9c512d8c424184d04f6051dd3fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa16c5505768410abafca5ffcafa2204', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:15.363530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:15.364032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:15.364530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:15.365571 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:15.366100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:15.368336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:15.380699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1215/2438] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:15:15.441890 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:15.455991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8ad62-83cd-4229-ae22-d5b9798bd507 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:15.460797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86ed9c512d8c424184d04f6051dd3fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa16c5505768410abafca5ffcafa2204', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:15.462113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:15.462394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:15.462662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] PATH_INFO: `/v3/projects/652514b44285470f920bcc83304baf68` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:15.463840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=652514b44285470f920bcc83304baf68)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:15.465763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:15.527253 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652514b44285470f920bcc83304baf68', 'request_id': 'req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:15.533455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652514b44285470f920bcc83304baf68', 'request_id': 'req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:15.543030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652514b44285470f920bcc83304baf68', 'request_id': 'req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:15.556358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] The token cache is being invalidate because project 652514b44285470f920bcc83304baf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:15.556720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:15.557482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1647cb97-c4e1-4bb1-891c-1d9ebcaa94cf tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:15.559116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1224/2439] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:15 2022] DELETE /identity/v3/projects/652514b44285470f920bcc83304baf68 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:15.787112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:15.790360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:15.884234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe41c9a-e8b1-4767-96d3-13c7d88538e3 tempest-VolumeQuotaClassesTest-1976106425 tempest-VolumeQuotaClassesTest-1976106425-project-admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:15.970400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:15.971349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:15.971721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:15.972088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] PATH_INFO: `/v3/users/6cd6f1f510a549eba3c23dfe41b8db97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:15.973459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd6f1f510a549eba3c23dfe41b8db97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:15.975460 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:16.030574 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd6f1f510a549eba3c23dfe41b8db97'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.031470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd6f1f510a549eba3c23dfe41b8db97'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.040289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd6f1f510a549eba3c23dfe41b8db97'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.040938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd6f1f510a549eba3c23dfe41b8db97'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.050405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd6f1f510a549eba3c23dfe41b8db97'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.068538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1216/2440] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:15 2022] DELETE /identity/v3/users/6cd6f1f510a549eba3c23dfe41b8db97 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:16.073576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:16.074098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:16.074381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:16.097260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:16.098484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.172158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1225/2441] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:16.178493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:16.179958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.245824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecabd0-e44e-4951-809e-a31680beb7c0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:16.250260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:16.250908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:16.251188 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:16.251463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:16.261674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:16.263098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:16.273233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1217/2442] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:16.716379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:16.717821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.744844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc566d-21cd-4c4b-99ce-912462561062 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:16.752226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:16.753425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:16.753786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:16.754206 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] PATH_INFO: `/v3/projects/781a6accb074455f85acd04a53f404eb` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:16.755916 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781a6accb074455f85acd04a53f404eb)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:16.758811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:16.805094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:16.806933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.819864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2ae5-b8c0-4c5e-8fef-7ce5e26028a7 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:16.821262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781a6accb074455f85acd04a53f404eb', 'request_id': 'req-03750581-6295-4774-a439-8fe5be4d6029'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.828737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781a6accb074455f85acd04a53f404eb', 'request_id': 'req-03750581-6295-4774-a439-8fe5be4d6029'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.838813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781a6accb074455f85acd04a53f404eb', 'request_id': 'req-03750581-6295-4774-a439-8fe5be4d6029'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.851862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] The token cache is being invalidate because project 781a6accb074455f85acd04a53f404eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:16.852196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.852865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:16.858063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1226/2443] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:16 2022] DELETE /identity/v3/projects/781a6accb074455f85acd04a53f404eb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:16.859049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:16.860874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.880162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:16.880929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:16.881312 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:16.881657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:16.883905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:16.940642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03750581-6295-4774-a439-8fe5be4d6029 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:16.945810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:16.946750 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:16.947021 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:16.947292 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] PATH_INFO: `/v3/users/86ed9c512d8c424184d04f6051dd3fc5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:16.948638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ed9c512d8c424184d04f6051dd3fc5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:16.951022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:16.957859 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:16.961084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:16.976210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1218/2444] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:15:17.015944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ed9c512d8c424184d04f6051dd3fc5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.016754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ed9c512d8c424184d04f6051dd3fc5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.033946 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ed9c512d8c424184d04f6051dd3fc5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.047851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ed9c512d8c424184d04f6051dd3fc5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.050084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d7fdbc05-7019-41a9-ab4e-44e2a701ace7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ed9c512d8c424184d04f6051dd3fc5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.077470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1227/2445] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:16 2022] DELETE /identity/v3/users/86ed9c512d8c424184d04f6051dd3fc5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:17.488294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:17.504474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca311d7-14cc-4796-abf0-fe0e143cfe39 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:17.589461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:17.590775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:17.591264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:17.591964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] PATH_INFO: `/v3/projects/aa16c5505768410abafca5ffcafa2204` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:17.595427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa16c5505768410abafca5ffcafa2204)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:17.598157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:17.674907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa16c5505768410abafca5ffcafa2204', 'request_id': 'req-d6d6b61c-9958-4abf-9a92-ef8b003721fb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.684564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa16c5505768410abafca5ffcafa2204', 'request_id': 'req-d6d6b61c-9958-4abf-9a92-ef8b003721fb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.694670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa16c5505768410abafca5ffcafa2204', 'request_id': 'req-d6d6b61c-9958-4abf-9a92-ef8b003721fb'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.713445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] The token cache is being invalidate because project aa16c5505768410abafca5ffcafa2204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:17.713908 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.715005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-d6d6b61c-9958-4abf-9a92-ef8b003721fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:17.730886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1219/2446] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:17 2022] DELETE /identity/v3/projects/aa16c5505768410abafca5ffcafa2204 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:17.739556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:17.740747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:17.741101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:17.781095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:17.782144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:17.926760 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1228/2447] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:17.934668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:17.935106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:17.936323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:17.957918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:17.959474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:17.970953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1220/2448] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:17.975348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:17.989920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7a81b-76cf-4bd6-addf-5510eeabd55d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:17.996979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:17.997797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:17.997966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:17.998340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:17.999648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:18.000068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.001853 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.022025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1229/2449] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:18.024340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.034098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f6d9f-95db-4b1c-a187-e16d36920896 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.039432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.040100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.040373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.040648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.041376 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.043285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.078862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1221/2450] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:18 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:18.083128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.098056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315476df-2ec3-42f1-9f55-e98177a8f48b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.181940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.182918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.183275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.183691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.184461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.200255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.250587 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1230/2451] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:18 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:15:18.252066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.266684 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420d4ff-b127-4bc8-aef4-ce9bed0d4c2c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.276102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.277750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.278220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.278660 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.279654 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.281999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.297890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1222/2452] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:18.299234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.315919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23d8bd-ed08-430c-80b0-e0b72cf91d00 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.322388 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.323071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.323422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.323767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.324633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.326336 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9d10-6f49-4532-a6c7-09813985f9c8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.341709 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1231/2453] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:18.342954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.362852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd672c7-5b23-476a-b110-40b3ad20dd88 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.374340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.375249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.375536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.375820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] PATH_INFO: `/v3/projects/3a5ba79d9a2646e1bef2b6d942a495d8/users/6662489b786a47afb2b6e112ec3467aa/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.410786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5ba79d9a2646e1bef2b6d942a495d8, user_id=6662489b786a47afb2b6e112ec3467aa, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.414929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.443582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1223/2454] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:18 2022] PUT /identity/v3/projects/3a5ba79d9a2646e1bef2b6d942a495d8/users/6662489b786a47afb2b6e112ec3467aa/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:18.454040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.454040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.454040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.490283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] MFA Rules not processed for user `6662489b786a47afb2b6e112ec3467aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:18.493620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:18.601720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1232/2455] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:18.605689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.687712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820f049-d167-499d-8b79-939f5409375c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.702229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.703160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.704163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.704487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.705245 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.707157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.744529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1224/2456] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:18 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:18.748139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.764320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794f1f3-7fb3-43b8-9309-2b955aef30c1 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.858961 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.859565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.860425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.860425 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.860789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.863025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.900889 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1233/2457] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:18 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:15:18.901810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.924400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707b548-84a5-4446-936b-b284606ed596 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:18.942674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:18.943358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:18.943635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:18.943918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:18.946333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:18.950018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:18.973930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1225/2458] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:18.975329 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:18.987394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4109f-57a8-43d4-be6d-7be5218a42bf admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:19.003164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:19.004160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.004515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.004960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] PATH_INFO: `/v3/projects/91011521126643a69dce9dd1c4947085/users/3c66497fa54e4bea85e843966e9931e5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.037963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91011521126643a69dce9dd1c4947085, user_id=3c66497fa54e4bea85e843966e9931e5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:19.043359 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:19.066235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1234/2459] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:18 2022] PUT /identity/v3/projects/91011521126643a69dce9dd1c4947085/users/3c66497fa54e4bea85e843966e9931e5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:19.070561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:19.090067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ee28-37df-4714-9a8f-6b0391082d4d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:19.168668 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:19.169377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.169879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.170159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.172296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:19.174181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d83ec-1eed-46d9-b0ff-0c16a1ffcc09 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:19.185110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1226/2460] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:19.189757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:19.203423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29a3d57-cf06-4782-b5b0-c2157ed8e788 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:19.208260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:19.209177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.209457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.209730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] PATH_INFO: `/v3/projects/91011521126643a69dce9dd1c4947085/users/3c66497fa54e4bea85e843966e9931e5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.212275 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91011521126643a69dce9dd1c4947085, user_id=3c66497fa54e4bea85e843966e9931e5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:19.214905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:19.227483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1235/2461] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:19 2022] PUT /identity/v3/projects/91011521126643a69dce9dd1c4947085/users/3c66497fa54e4bea85e843966e9931e5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:19.238357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.238791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.240928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.270094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] MFA Rules not processed for user `3c66497fa54e4bea85e843966e9931e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:19.271291 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:19.342770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1227/2462] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:19.352984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:19.354759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:19.413538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3065de-a884-408a-ba87-ded5a66ef0d3 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:19.418501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:19.419214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.419585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.420241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.431015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:19.432447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:19.442236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1236/2463] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:19.690950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:19.702357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54658aa-fa35-47cc-a1e5-975ba33e0af5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:19.706477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:19.707350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:19.707791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:19.708238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:19.781125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:19.782582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92d74d-27fc-4776-9598-6a2add6eebb4 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:19.792681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1228/2464] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:20.060510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:20.136609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f72d17-c1dc-4b65-9cfe-86a536eb36d2 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:20.141591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:20.142564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:20.142907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:20.143571 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] PATH_INFO: `/v3/users/6662489b786a47afb2b6e112ec3467aa` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:20.144616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6662489b786a47afb2b6e112ec3467aa)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:20.146693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:20.202057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6662489b786a47afb2b6e112ec3467aa'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.202721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6662489b786a47afb2b6e112ec3467aa'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.218494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6662489b786a47afb2b6e112ec3467aa'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.227703 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6662489b786a47afb2b6e112ec3467aa'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.228812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6662489b786a47afb2b6e112ec3467aa'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.244685 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1237/2465] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:20 2022] DELETE /identity/v3/users/6662489b786a47afb2b6e112ec3467aa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:20.250328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:20.250613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:20.250900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:20.268083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:20.269989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:20.335548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1229/2466] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:20.345463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:20.346965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:20.406707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567ea-fbe0-4970-b953-d7680aa9dcc9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:20.410408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:20.411207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:20.411491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:20.411759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:20.421596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:20.423025 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:20.434404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1238/2467] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:20.732051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:20.733502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:20.756955 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d482a68-f83f-4d5c-9f4e-b239c5190a21 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:20.767208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:20.768175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:20.768557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:20.768923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] PATH_INFO: `/v3/projects/3a5ba79d9a2646e1bef2b6d942a495d8` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:20.770461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5ba79d9a2646e1bef2b6d942a495d8)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:20.773516 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:20.839638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5ba79d9a2646e1bef2b6d942a495d8', 'request_id': 'req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.848122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5ba79d9a2646e1bef2b6d942a495d8', 'request_id': 'req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.855939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5ba79d9a2646e1bef2b6d942a495d8', 'request_id': 'req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.867836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] The token cache is being invalidate because project 3a5ba79d9a2646e1bef2b6d942a495d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:20.868374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.869328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:20.871236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1230/2468] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:20 2022] DELETE /identity/v3/projects/3a5ba79d9a2646e1bef2b6d942a495d8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:20.875497 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:20.885955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707f885-1a14-4cc6-8de2-4914c2633372 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:20.946460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:20.947485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:20.947930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:20.948304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] PATH_INFO: `/v3/users/3c66497fa54e4bea85e843966e9931e5` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:20.949544 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c66497fa54e4bea85e843966e9931e5)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:20.953468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.001519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c66497fa54e4bea85e843966e9931e5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.002788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c66497fa54e4bea85e843966e9931e5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.014880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c66497fa54e4bea85e843966e9931e5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.023068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c66497fa54e4bea85e843966e9931e5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.023791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c783c8b0-7bfa-458d-a22e-d281ad891c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c66497fa54e4bea85e843966e9931e5'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.036568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1239/2469] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:20 2022] DELETE /identity/v3/users/3c66497fa54e4bea85e843966e9931e5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:21.307892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.309366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:21.324397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2a6d-5c18-45c9-b08a-5eef9a3115a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.378533 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.379380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.379658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.379928 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] PATH_INFO: `/v3/projects/91011521126643a69dce9dd1c4947085` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.381183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91011521126643a69dce9dd1c4947085)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.383958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.428614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91011521126643a69dce9dd1c4947085', 'request_id': 'req-4e476066-1567-46f6-aa20-75e06948aba2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.435223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91011521126643a69dce9dd1c4947085', 'request_id': 'req-4e476066-1567-46f6-aa20-75e06948aba2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.441599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91011521126643a69dce9dd1c4947085', 'request_id': 'req-4e476066-1567-46f6-aa20-75e06948aba2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.453467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] The token cache is being invalidate because project 91011521126643a69dce9dd1c4947085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:21.453774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.454469 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4e476066-1567-46f6-aa20-75e06948aba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:21.455979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1231/2470] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:21 2022] DELETE /identity/v3/projects/91011521126643a69dce9dd1c4947085 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:21.461470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.461954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.462061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.478839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:21.480023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:21.535104 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1240/2471] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:21.542997 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.543284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.543560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.561235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:21.562397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:21.570729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1232/2472] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:21.574690 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.583895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ac5a0-9fa5-45a2-9b6e-877973030b12 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.589271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.589911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.590192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.590461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.591172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:21.591475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.593045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.604116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1241/2473] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:21.608249 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.617098 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64edb3-3ad4-4df3-8ed0-ce441aa4f83b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.621689 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.622319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.622597 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.622868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.623545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.625727 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.652110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1233/2474] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:21.656164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.666164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8ec8e-6bff-483f-a412-805e047cc356 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.719458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.720120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.720400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.720674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.721398 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.723273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.743435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1242/2475] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:21.747512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.758611 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee9005-ef76-42bf-a67d-7e942b94e8ed admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.763209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.763854 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.764136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.764408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.765157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.766729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.778128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1234/2476] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:21.781991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.791777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c91a5-2b38-423a-8349-b8316306734c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.796255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.796888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.797224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.797501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.798221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.799830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc3dd9-33bb-4d96-8a11-5c166d6481d5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.810097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1243/2477] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:21.814018 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:21.824282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aae65-f1e5-4718-bd80-e1d4ec2a2004 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:21.828893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:21.829788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.830069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.830384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] PATH_INFO: `/v3/projects/08c2a3b237c642fdb5b0e949a3770140/users/3f37256ccd674d058c0df135d41c6685/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.844548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c2a3b237c642fdb5b0e949a3770140, user_id=3f37256ccd674d058c0df135d41c6685, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:21.847332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:21.860976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1235/2478] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:21 2022] PUT /identity/v3/projects/08c2a3b237c642fdb5b0e949a3770140/users/3f37256ccd674d058c0df135d41c6685/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:21.872702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:21.872988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:21.873309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:21.899615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] MFA Rules not processed for user `3f37256ccd674d058c0df135d41c6685`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:21.900801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:21.961815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1244/2479] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:21.966567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.026357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1fb7-a988-4252-9cea-7d68384a059c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.030979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.031624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.031907 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.032180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.032964 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.034984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.059130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1236/2480] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:21 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:22.063074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.073892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494967-5083-4542-a0d5-36180aefacf4 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.129278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.129922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.130563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.130862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.131533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.134122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.154598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1245/2481] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:22 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:22.158535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.168629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d64c12-8a69-405b-854a-262a698a23f0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.173338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.174009 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.174286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.174564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.175285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.176864 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.190399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1237/2482] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:15:22.191570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.201847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66909d-7a51-4ce3-997b-cc3f13450114 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.206494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.207392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.207675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.207949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] PATH_INFO: `/v3/projects/320ca0ee7729408cbe5325fdf08bd263/users/8b387750bd6e4014991fe549a7303325/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.223818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=320ca0ee7729408cbe5325fdf08bd263, user_id=8b387750bd6e4014991fe549a7303325, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.226546 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.239417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1246/2483] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:22 2022] PUT /identity/v3/projects/320ca0ee7729408cbe5325fdf08bd263/users/8b387750bd6e4014991fe549a7303325/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:22.243264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.253427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a62ab4-29fd-423b-aa7b-4da83f36c503 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.307447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.308103 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.308382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.308655 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.309465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.310946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511f8a6-350d-4cba-b16e-cd49771ab72e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.320705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1238/2484] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:22.324885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.335924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc64f8-d503-4f10-9f26-09e449e4f1e0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.340432 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.341386 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.341663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.341936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] PATH_INFO: `/v3/projects/320ca0ee7729408cbe5325fdf08bd263/users/8b387750bd6e4014991fe549a7303325/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.343854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=320ca0ee7729408cbe5325fdf08bd263, user_id=8b387750bd6e4014991fe549a7303325, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.346438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.356288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1247/2485] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:22 2022] PUT /identity/v3/projects/320ca0ee7729408cbe5325fdf08bd263/users/8b387750bd6e4014991fe549a7303325/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:22.366420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0233726-71ca-4835-9b7b-583f58e42bd8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.366708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0233726-71ca-4835-9b7b-583f58e42bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.366982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0233726-71ca-4835-9b7b-583f58e42bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.394270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a0233726-71ca-4835-9b7b-583f58e42bd8 None None] MFA Rules not processed for user `8b387750bd6e4014991fe549a7303325`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:22.395450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a0233726-71ca-4835-9b7b-583f58e42bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:22.460287 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1239/2486] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:22.469625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:22.471332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:22.525302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b905d-9d1b-4338-9aa9-95ae7d050504 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:22.528879 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:22.529537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:22.529818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:22.530090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:22.584604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:22.586144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c77d24-6020-4ad8-89e7-ee3cc4feff18 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:22.594720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1248/2487] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:23.979978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:23.980481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:23.980579 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:23.982804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1240/2488] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:15:23.988999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ea33-7c4f-46a2-89d2-97fdc395b180 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:23.989519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ea33-7c4f-46a2-89d2-97fdc395b180 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:23.989635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5ea33-7c4f-46a2-89d2-97fdc395b180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.030160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3fe5ea33-7c4f-46a2-89d2-97fdc395b180 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:24.031373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3fe5ea33-7c4f-46a2-89d2-97fdc395b180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.101948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1249/2489] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:15:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:24.114019 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:24.115993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.198166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c0780-1bc0-45cd-bc71-0a37aa3ab254 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:24.202248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:24.202925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.203146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.203415 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.215017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:24.217443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ca74b-beb1-49a7-ab47-e1fb2aebfa63 service glance] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:24.235706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1241/2490] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:24.315496 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.315783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.316060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.317896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1250/2491] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:15:24.322773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916769d-8300-4fee-9f2d-95851ef33f63 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.323065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916769d-8300-4fee-9f2d-95851ef33f63 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.323349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916769d-8300-4fee-9f2d-95851ef33f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.342505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b916769d-8300-4fee-9f2d-95851ef33f63 None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:24.343669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b916769d-8300-4fee-9f2d-95851ef33f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.400590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1242/2492] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:15:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:24.412037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:24.413877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.428782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ffde8-90cb-4d30-8ad9-d05ae33a7a00 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:24.432661 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:24.433448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.433723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.433991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.440867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:24.442279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7901c24c-5a00-4e28-8307-bc3d2d2842aa service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:24.450281 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1251/2493] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:24.539647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139906-d87d-4388-97f2-db9f746847fb None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.539933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139906-d87d-4388-97f2-db9f746847fb None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.540210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18139906-d87d-4388-97f2-db9f746847fb None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.542015 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1243/2494] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:15:24.547197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.547485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.547765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.565699 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:24.566897 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.576512 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1252/2495] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:15:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:24.587756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139906-d87d-4388-97f2-db9f746847fb None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:24.589436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-18139906-d87d-4388-97f2-db9f746847fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:24.602694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18139906-d87d-4388-97f2-db9f746847fb None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:24.606239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:24.606858 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:24.607136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:24.607413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:24.617272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:24.618688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1be28-aae6-4067-8c6e-52479e12a625 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:24.629181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1244/2496] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:26.736839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:26.746442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde2be8-a944-4e55-b17d-cbaed89090c1 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:26.750637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:26.751402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:26.751702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:26.752167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:26.761796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:26.763310 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:26.774223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1253/2497] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:26.886865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:26.887344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:26.887344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:26.907106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:26.908315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:26.965477 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1245/2498] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:15:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:26.980006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:26.981608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:27.063391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08def0-a3a4-477d-84cf-5651dcf2921f service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:27.068605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:27.069899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:27.070222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:27.070575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:27.078654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:27.080216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2e332-e7f6-4b7b-bc39-eaa42afc09ad service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:27.088234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1254/2499] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:15:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 10:15:31.629548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:31.697208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d27e-cc3d-4249-be9b-3d35706e8468 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:31.701799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:31.702663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:31.702944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:31.703218 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] PATH_INFO: `/v3/users/3f37256ccd674d058c0df135d41c6685` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:31.704396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f37256ccd674d058c0df135d41c6685)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:31.706310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:31.751333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f37256ccd674d058c0df135d41c6685'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:31.751996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f37256ccd674d058c0df135d41c6685'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:31.760127 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f37256ccd674d058c0df135d41c6685'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:31.760745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f37256ccd674d058c0df135d41c6685'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:31.767823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f37256ccd674d058c0df135d41c6685'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:31.804904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1246/2500] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:31 2022] DELETE /identity/v3/users/3f37256ccd674d058c0df135d41c6685 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:31.806720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:31.808125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:31.808549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:31.830622 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:31.832247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:31.899401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1255/2501] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:31.909084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:31.910540 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:31.966280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f49bfc-9c2e-4acc-aa7f-9faad8689246 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:31.969878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:31.970514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:31.970795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:31.971070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:31.980371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:31.981810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:31.990903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1247/2502] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:32.277769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:32.279199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:32.302471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e014-a451-4b0d-b02c-7050373e32c3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:32.307698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:32.308542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:32.308823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:32.309126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] PATH_INFO: `/v3/projects/08c2a3b237c642fdb5b0e949a3770140` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:32.310298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c2a3b237c642fdb5b0e949a3770140)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:32.312197 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:32.358053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c2a3b237c642fdb5b0e949a3770140', 'request_id': 'req-a999e693-e106-4ec8-b511-da4e97c93024'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.363407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c2a3b237c642fdb5b0e949a3770140', 'request_id': 'req-a999e693-e106-4ec8-b511-da4e97c93024'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.371088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c2a3b237c642fdb5b0e949a3770140', 'request_id': 'req-a999e693-e106-4ec8-b511-da4e97c93024'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.382523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] The token cache is being invalidate because project 08c2a3b237c642fdb5b0e949a3770140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:32.382807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.384018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.385874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1256/2503] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:32 2022] DELETE /identity/v3/projects/08c2a3b237c642fdb5b0e949a3770140 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:32.389874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:32.399706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7038c-0332-4b3d-9a38-44af15d969e7 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:32.454537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:32.455405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:32.455706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:32.455963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] PATH_INFO: `/v3/users/8b387750bd6e4014991fe549a7303325` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:32.457187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b387750bd6e4014991fe549a7303325)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:32.459075 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:32.505992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b387750bd6e4014991fe549a7303325'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.506708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b387750bd6e4014991fe549a7303325'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.515731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b387750bd6e4014991fe549a7303325'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.516457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b387750bd6e4014991fe549a7303325'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.526647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e47b3c40-df7a-4393-8b18-9de9fad1db85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b387750bd6e4014991fe549a7303325'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:32.546905 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1248/2504] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:32 2022] DELETE /identity/v3/users/8b387750bd6e4014991fe549a7303325 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:15:32.881330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:32.883018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:32.897523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e693-e106-4ec8-b511-da4e97c93024 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:32.972414 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:32.973331 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:32.973611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:32.973883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] PATH_INFO: `/v3/projects/320ca0ee7729408cbe5325fdf08bd263` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:32.975119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=320ca0ee7729408cbe5325fdf08bd263)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:32.977830 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.031241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320ca0ee7729408cbe5325fdf08bd263', 'request_id': 'req-f1a5270c-9dde-458c-8e8b-a0e3482ba025'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:33.036711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320ca0ee7729408cbe5325fdf08bd263', 'request_id': 'req-f1a5270c-9dde-458c-8e8b-a0e3482ba025'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:33.045859 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320ca0ee7729408cbe5325fdf08bd263', 'request_id': 'req-f1a5270c-9dde-458c-8e8b-a0e3482ba025'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:33.058214 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] The token cache is being invalidate because project 320ca0ee7729408cbe5325fdf08bd263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:33.058682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:33.059349 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f1a5270c-9dde-458c-8e8b-a0e3482ba025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:33.065144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1257/2505] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:32 2022] DELETE /identity/v3/projects/320ca0ee7729408cbe5325fdf08bd263 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:33.067207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.067724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.067828 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.086559 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:33.087800 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:33.149040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1249/2506] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:33.158686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.159026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.159307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.177503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:33.178714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:33.187028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1258/2507] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:33.191205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.201273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607551-a77f-4d33-8098-81c2fa235cb3 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.205785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.206425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.206706 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.206978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.207688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:33.207993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.209596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.221217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1250/2508] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:33.225394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.235182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a077-b1c5-45e9-994b-911d3f9ec0e5 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.243664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.244762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.245477 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.246018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.246846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.249378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.291580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1259/2509] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:33 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:33.292430 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.304624 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb220b-fb41-47ac-8103-593248dc726d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.375992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.377040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.377347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.377626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.378321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.380252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.400578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1251/2510] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:33 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:15:33.404695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.415744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9786fe-d626-4910-83ce-c974aabcdc8e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.420534 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.421232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.421516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.421788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.422515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.424277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.435595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1260/2511] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:33.439227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.450507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16079ea8-b961-4b2b-ac0c-bca7a868a4d6 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.455530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.456234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.456524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.456807 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.457570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.459164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed2ef2-d8e2-4c36-877e-bb5e1da3c3e8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.469688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1252/2512] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:15:33.473856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.483467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704722aa-95bf-4e32-a23a-f43947c00061 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.487975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.488827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.489131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.489402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] PATH_INFO: `/v3/projects/827cccc3714f4fd9897b9b3ce9ef25e3/users/27d92a3770f14afcb6e74f1175e338c6/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.503625 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827cccc3714f4fd9897b9b3ce9ef25e3, user_id=27d92a3770f14afcb6e74f1175e338c6, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.506278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.541527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1261/2513] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:33 2022] PUT /identity/v3/projects/827cccc3714f4fd9897b9b3ce9ef25e3/users/27d92a3770f14afcb6e74f1175e338c6/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:15:33.544563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.545358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.545772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.578719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] MFA Rules not processed for user `27d92a3770f14afcb6e74f1175e338c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:33.580110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:33.681711 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1253/2514] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:33.692065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:33.693884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:33.748521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f8eb3-66e0-448d-8c42-2c366fdced66 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:33.752421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:33.753098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:33.753378 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:33.753647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:33.762407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:33.763800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa18f2-254e-422d-9794-9a3ce6d9285e service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:33.772252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1262/2515] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:36.317614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:36.381530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b79de-341e-4527-9ec5-aee8e81e9731 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:36.387755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:36.388814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:36.389124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:36.389542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] PATH_INFO: `/v3/users/27d92a3770f14afcb6e74f1175e338c6` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:36.391336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d92a3770f14afcb6e74f1175e338c6)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:36.393875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:36.453007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d92a3770f14afcb6e74f1175e338c6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:36.453742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d92a3770f14afcb6e74f1175e338c6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:36.465105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d92a3770f14afcb6e74f1175e338c6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:36.465820 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d92a3770f14afcb6e74f1175e338c6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:36.473013 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d92a3770f14afcb6e74f1175e338c6'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:36.490064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1254/2516] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:36 2022] DELETE /identity/v3/users/27d92a3770f14afcb6e74f1175e338c6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:36.494645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:36.495192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:36.495302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:36.513241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:36.514422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:36.571807 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1263/2517] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:36.581388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:36.583447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:36.641451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf73cfbf-b2e1-491a-a0ac-aeee81b96817 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:36.645112 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:36.645813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:36.646109 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:36.646406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:36.657382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:36.658940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b0a33-17e0-4379-b1ab-9f3b09dfcda6 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:36.671555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1255/2518] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:36.982243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:36.983754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:36.998705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838aad9-c861-43c1-80c4-24dac4a196bb None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.004446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.005402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.005584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.005861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] PATH_INFO: `/v3/projects/827cccc3714f4fd9897b9b3ce9ef25e3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.007033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827cccc3714f4fd9897b9b3ce9ef25e3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.009583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.054762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827cccc3714f4fd9897b9b3ce9ef25e3', 'request_id': 'req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.060107 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827cccc3714f4fd9897b9b3ce9ef25e3', 'request_id': 'req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.067700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827cccc3714f4fd9897b9b3ce9ef25e3', 'request_id': 'req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.089187 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] The token cache is being invalidate because project 827cccc3714f4fd9897b9b3ce9ef25e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:37.089620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.090695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3f25e81-3d98-4a9e-8f28-f5ffc067fae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.105649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1264/2519] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:36 2022] DELETE /identity/v3/projects/827cccc3714f4fd9897b9b3ce9ef25e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:15:37.107674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.108046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.108343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.128465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:37.129734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:37.212198 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1256/2520] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:37.219773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.220136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.220481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.256295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:37.257779 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:37.265618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1265/2521] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:37.269865 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.279166 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff0aae-e7d5-4102-85f8-6d535756f2f6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.283944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.284590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.284866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.285164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.285877 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:37.286182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.287763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.299721 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1257/2522] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:37.304073 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.313924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a8d18-4927-4860-b084-5368e4a02f45 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.318683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.319241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.319521 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.319796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.320471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.322488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.347141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1266/2523] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:37.351186 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.361488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83623-404f-4c21-8f42-8aa63616a083 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.417000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.417717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.418030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.418360 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.419041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.420910 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.439788 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1258/2524] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:37.443814 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.453865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749286a4-39ca-4062-b2d3-8ee982b1bd20 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.458427 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.459063 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.459337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.459605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.460311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.462467 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.472396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1267/2525] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:37.476152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.486501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4f767-b32d-41df-9c86-adcb1d150b5a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.491051 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.491696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.491979 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.492762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.493511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.495068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7b160-d4ee-4442-b0f8-f83a9f26c572 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.504863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1259/2526] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:37.509147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.518599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4769a-f398-47bb-8a33-95208ba1cdf4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.523110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.523979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.524252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.524518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] PATH_INFO: `/v3/projects/dc4f2f8d907d4ea79427076b0e44170f/users/a425960b05a04ffd99e2790df8a3b8b0/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.538117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4f2f8d907d4ea79427076b0e44170f, user_id=a425960b05a04ffd99e2790df8a3b8b0, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.540718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.552777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1268/2527] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:37 2022] PUT /identity/v3/projects/dc4f2f8d907d4ea79427076b0e44170f/users/a425960b05a04ffd99e2790df8a3b8b0/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:37.564938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.565257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.565784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.598247 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] MFA Rules not processed for user `a425960b05a04ffd99e2790df8a3b8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:37.599481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:37.665717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1260/2528] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:37.675695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.677396 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:37.736381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102109c-6024-4db1-87ce-3950625d96d4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.739933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.740559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.740836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.741198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.749465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.750861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc4957-700b-47f9-9506-777d037f2959 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.759864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1269/2529] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:37.784026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:37.842835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f4ad6-6935-4ad4-8888-0ab5a95486f2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:37.847407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:37.848256 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.848542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.848809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] PATH_INFO: `/v3/users/a425960b05a04ffd99e2790df8a3b8b0` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.850024 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a425960b05a04ffd99e2790df8a3b8b0)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:37.851950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:37.895860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a425960b05a04ffd99e2790df8a3b8b0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.896526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a425960b05a04ffd99e2790df8a3b8b0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.904315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a425960b05a04ffd99e2790df8a3b8b0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.905159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a425960b05a04ffd99e2790df8a3b8b0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.911736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a425960b05a04ffd99e2790df8a3b8b0'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:37.927901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1261/2530] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:15:37 2022] DELETE /identity/v3/users/a425960b05a04ffd99e2790df8a3b8b0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:37.932415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:37.932700 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:37.932998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:37.950320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:37.951494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:38.006309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1270/2531] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:38.016174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.017589 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:38.074779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b001df5-a559-4fa3-9e12-27f02d56de8d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.078536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.079190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.079471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.079744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.089772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.091239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f38f7-1d95-4d63-a6af-651deb297cb2 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.102602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1262/2532] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:38.397815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.399778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:38.413335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5610d-bb3b-448b-b740-751298a4801e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.418648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.419589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.419936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.420280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] PATH_INFO: `/v3/projects/dc4f2f8d907d4ea79427076b0e44170f` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.421607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4f2f8d907d4ea79427076b0e44170f)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.423574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.511235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4f2f8d907d4ea79427076b0e44170f', 'request_id': 'req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:38.518053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4f2f8d907d4ea79427076b0e44170f', 'request_id': 'req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:38.531031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4f2f8d907d4ea79427076b0e44170f', 'request_id': 'req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:38.547006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] The token cache is being invalidate because project dc4f2f8d907d4ea79427076b0e44170f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:15:38.547401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:38.548089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-f3618fef-35f5-4ee9-a4d3-4dc9d69e6626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:15:38.549888 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1271/2533] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:15:38 2022] DELETE /identity/v3/projects/dc4f2f8d907d4ea79427076b0e44170f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:38.555525 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.556081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.556081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.573870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:38.575136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:38.638912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1263/2534] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:15:38.647678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.647960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.648317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.673737 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:38.675090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:38.685420 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1272/2535] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:38.687742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.698358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb353f-bb98-4380-87c4-f61d10281201 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.703371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.704039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.704323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.704658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.705435 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:15:38.705757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.707345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.720069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1264/2536] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:15:38.724284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.733362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccb1c0-5b7f-4d91-ba0f-791c52fc666f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.738311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.738962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.739237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.739565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.740250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.742193 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.769158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1273/2537] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:38 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:38.772101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.782753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d04-e971-48d5-9c2d-5d5108895475 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.836742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.837427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.837708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.837976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.838648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.840529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.860922 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1265/2538] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:38 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:38.864993 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.875996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75adaf2-1e87-4795-81b6-4cfd03947596 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.880902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.881647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.881988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.882309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.883677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.885503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.896561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1274/2539] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:15:38.900716 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.910498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae4a08-85cc-48ac-885e-c0aea132bd1a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.915121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.915768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.916066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.916324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.917040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.918738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e35b9-bea8-4a9d-b929-a202929e08ab admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.928326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1266/2540] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:38.932921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:38.942605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ddee0-06be-49b3-8fca-5945318a7eec admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:38.947919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:38.948780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.949180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.949458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] PATH_INFO: `/v3/projects/68a2e2fa5e5645e9bf0bb37230fc6b20/users/1c9ee5e1ede94477a87ab423b99ba8b0/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:38.963684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a2e2fa5e5645e9bf0bb37230fc6b20, user_id=1c9ee5e1ede94477a87ab423b99ba8b0, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:38.966333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:38.978445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1275/2541] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:38 2022] PUT /identity/v3/projects/68a2e2fa5e5645e9bf0bb37230fc6b20/users/1c9ee5e1ede94477a87ab423b99ba8b0/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:15:38.983348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839e2d-13bf-467c-903f-848dc019181f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:38.983638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839e2d-13bf-467c-903f-848dc019181f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:38.983917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af839e2d-13bf-467c-903f-848dc019181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:39.001685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-af839e2d-13bf-467c-903f-848dc019181f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:39.002852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-af839e2d-13bf-467c-903f-848dc019181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:39.072354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1267/2542] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:39.081608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:39.083713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:39.158952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411609b-b69a-4d31-b12c-fcc4590c1ac6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:39.162854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:39.163556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:39.164536 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:39.164877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:39.174240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:39.175660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:39.185820 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1276/2543] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:43.553786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:43.554844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:43.554844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:43.582773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] MFA Rules not processed for user `1c9ee5e1ede94477a87ab423b99ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:43.584122 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:43.658570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1268/2544] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:43.660773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:43.670740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48d2cc-80ab-420d-ae03-ae8869d76f45 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:43.676029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:43.676856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:43.677341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:43.677765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:43.678636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:43.681309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:43.712337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1277/2545] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:15:43 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:43.716323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:43.732750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23c78-82bc-4c1a-ac62-996730b04fe1 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:43.813939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:43.814617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:43.814899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:43.815172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:43.816045 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:43.818275 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:43.845465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1269/2546] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:15:43 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:15:43.846744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:43.857963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b99254-426d-43ce-846b-a2b1d47203b4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:43.866057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:43.866777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:43.867048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:43.867323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:43.868311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:43.870010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:43.883155 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1278/2547] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:43.887457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:43.902026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486629d-997a-4998-94f6-e25bb87dec4d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:43.906801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:43.907645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:43.907924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:43.908206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] PATH_INFO: `/v3/projects/f402d16962ed46f489ff68ec1a192066/users/34ce564b93b54f43a59690a6a077eb85/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:43.924121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f402d16962ed46f489ff68ec1a192066, user_id=34ce564b93b54f43a59690a6a077eb85, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:43.926893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:43.949255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1270/2548] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:43 2022] PUT /identity/v3/projects/f402d16962ed46f489ff68ec1a192066/users/34ce564b93b54f43a59690a6a077eb85/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:15:43.951152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:43.967341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c08bbd-4250-4ee1-9592-05e7f51a6b0c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:44.035778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:44.036439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:44.036718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:44.036987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:44.037743 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:44.039358 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:44.049774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1279/2549] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:15:44.053838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:44.064197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fa372-0407-4397-a96a-6d04815d640b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:44.068952 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:44.069868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:44.070693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:44.070968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] PATH_INFO: `/v3/projects/f402d16962ed46f489ff68ec1a192066/users/34ce564b93b54f43a59690a6a077eb85/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:44.072931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f402d16962ed46f489ff68ec1a192066, user_id=34ce564b93b54f43a59690a6a077eb85, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:44.075568 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190cb73-e643-43c2-882d-8bc58de13e7e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:44.087999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1271/2550] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:15:44 2022] PUT /identity/v3/projects/f402d16962ed46f489ff68ec1a192066/users/34ce564b93b54f43a59690a6a077eb85/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:15:47.350672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:47.353397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:47.428906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bcf98-7789-4584-81cf-b0e78fb0042a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:47.556925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:47.558010 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:47.558285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:47.558936 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:47.561083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:47.694276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:47.697902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:47.715648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1280/2551] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:48.681796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:48.682311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:48.682311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:48.708427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] MFA Rules not processed for user `34ce564b93b54f43a59690a6a077eb85`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:48.709902 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:48.780757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1272/2552] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:48.795149 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:48.797132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:48.852509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81e1c-4ad7-4592-8cec-d4d7bcde8ec3 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:48.856098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:48.856733 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:48.857008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:48.857313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:48.924869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:48.926364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8f11b-ff16-4ece-8006-8126f5c50a7b service glance] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:48.936578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1281/2553] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:48.998257 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:49.015140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569cdf4-c874-4167-bffd-9bc3c024e8a5 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:49.021184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:49.021916 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:49.022255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:49.023712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:49.025622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:49.047365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:49.050150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:49.063373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1273/2554] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:49.073540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:49.073972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:49.074309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:49.094220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:49.095856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:49.178355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1282/2555] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:15:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:49.198302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:49.199888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:49.281266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a77192-0f92-42c4-8fe7-124809b83735 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:49.286484 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:49.287139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:49.287422 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:49.287699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:49.296468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:49.298081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14277380-d5a7-4556-ae12-93c84a5fc2f3 service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:49.306766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1274/2556] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:15:50.251078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:50.252480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:50.269842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b201a-48e8-4acc-a8f0-6d143ddf7657 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:50.276153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:50.276822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:50.277158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:50.277438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:50.279243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:50.370713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:50.372549 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:50.396144 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1283/2557] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:57.630694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a93d-0c39-4e48-900f-9512657150d8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:57.631229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a93d-0c39-4e48-900f-9512657150d8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:57.631229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1a93d-0c39-4e48-900f-9512657150d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:57.665485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9fd1a93d-0c39-4e48-900f-9512657150d8 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:57.666819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9fd1a93d-0c39-4e48-900f-9512657150d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:57.681255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1275/2558] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:57.691263 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:57.704364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef6332-d89c-4c17-89ed-9ad03081b604 service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:57.711815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:57.712526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:57.712812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:57.713113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:57.721990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:57.723548 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:57.734296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1284/2559] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:15:58.816143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:58.816697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:58.816697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:58.834622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] MFA Rules not processed for user `1c9ee5e1ede94477a87ab423b99ba8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:15:58.836451 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:58.843397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1276/2560] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:15:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:15:59.091691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:59.101453 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b421ae-9e6f-4808-982d-4ca97160c814 service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:59.105034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:59.105683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:59.105964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:59.106424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:59.107978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:59.117670 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:59.119072 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624dd3b-a35b-41c4-a5ed-200b3f2f403e service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:59.126992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1285/2561] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:15:59.514600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:15:59.515985 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:59.584017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c72e-7869-497b-982e-a533b270f1ac None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:15:59.591457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:15:59.592097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:15:59.592381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:15:59.592649 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:15:59.594411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:15:59.607366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:15:59.608898 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:15:59.619542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1277/2562] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:16:00.749802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:00.750279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:00.750403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:00.768492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:16:00.769687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:16:00.777249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1286/2563] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:16:00.790084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:16:00.800948 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989472d-59f5-4326-aebb-f5dae78e7115 service placement] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:16:00.806550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:16:00.807196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:00.807478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:00.807752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:00.816048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:16:00.817644 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:16:00.826639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1278/2564] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:16:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:16:08.715137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:16:08.716523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:16:08.732552 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e89481-e05e-4282-902b-2df06574a12b None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:16:08.738004 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:16:08.738635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:08.738911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:08.739184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:08.740915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:16:08.798276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:16:08.799980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:16:08.810280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1287/2565] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:16:15.204182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:16:15.219346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c36b95-4fba-4882-839f-84626b2f9c3d service swift] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:16:15.222973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:16:15.223607 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:15.223885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:15.224156 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:15.225934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:16:15.238297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:16:15.239917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:16:15.249332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1279/2566] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:16:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:16:34.226977 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:16:34.236840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efc3c8-19bb-4ebe-b2b6-b6d6c1f03930 service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:16:34.240393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:16:34.241162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:34.241446 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:34.241721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:34.251602 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:16:34.252998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871d6af-6dfc-49b4-b8cf-d9f33d4f8b83 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:16:34.262059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1288/2567] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:16:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:16:36.104621 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:16:36.119343 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d7753-10e2-49da-b3d3-ba82480ce799 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:16:36.133004 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:16:36.133712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:16:36.133998 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:16:36.134273 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:16:36.136121 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:16:36.148822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:16:36.151148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:16:36.163551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1280/2568] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:16:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:17:07.141617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:07.142249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:07.142249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:07.159506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] MFA Rules not processed for user `c737f50ef7264ed983209d16e28da75b`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:17:07.160688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:07.167556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1289/2569] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:17:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:17:15.688029 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:17:15.702338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09947-e032-408d-89ff-158c2ed843ab service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:17:15.707903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:17:15.708529 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:15.708814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:15.709110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:15.710869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:15.722895 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:17:15.724744 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794efcc-db4d-4059-b2d7-3b015fcc03e5 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:17:15.735355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1281/2570] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:17:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:17:27.637810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:17:27.647141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf54ae8-0801-4b6d-97e2-f09039d1a45f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:17:27.650752 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:17:27.651377 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:27.651660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:27.651941 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:27.653701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:27.662923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:17:27.664325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd7bb89-15ae-46a7-ad1e-5d8eb1c612e1 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:17:27.672017 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1290/2571] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:17:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:17:28.779458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a595eb-e54b-4bf5-a67a-5d0404edc293 None None] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:28.780022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a595eb-e54b-4bf5-a67a-5d0404edc293 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:28.780132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a595eb-e54b-4bf5-a67a-5d0404edc293 None None] PATH_INFO: `/` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:28.782061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1282/2572] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:17:28.788298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ae47-4d4b-40eb-96fe-a049665c7189 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:28.788742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ae47-4d4b-40eb-96fe-a049665c7189 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:28.788968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ae47-4d4b-40eb-96fe-a049665c7189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:28.807538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fe68ae47-4d4b-40eb-96fe-a049665c7189 None None] MFA Rules not processed for user `7ce1c786c9fd4009aba04bccafdd01e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:17:28.808776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fe68ae47-4d4b-40eb-96fe-a049665c7189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:28.815479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1291/2573] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:17:28.828056 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a595eb-e54b-4bf5-a67a-5d0404edc293 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:17:28.839636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a595eb-e54b-4bf5-a67a-5d0404edc293 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:17:28.843459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:17:28.844155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:28.844523 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:28.844863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:28.852187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:17:28.853764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8dd554-48ef-49f6-9290-2e540a42ee30 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:17:28.861696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1283/2574] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:17:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:17:28.976895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b980ad-8217-4437-9b49-7dcb8103f89c None None] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:28.977210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b980ad-8217-4437-9b49-7dcb8103f89c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:28.977480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b980ad-8217-4437-9b49-7dcb8103f89c None None] PATH_INFO: `/` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:28.979264 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1292/2575] 10.222.0.73 () {54 vars in 921 bytes} [Mon Feb 21 10:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 21 10:17:28.984701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17109bf-2f0f-4218-8957-eda60e1cfdd2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:28.984987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17109bf-2f0f-4218-8957-eda60e1cfdd2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:28.985297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17109bf-2f0f-4218-8957-eda60e1cfdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:29.004016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e17109bf-2f0f-4218-8957-eda60e1cfdd2 None None] MFA Rules not processed for user `3f538116ef3047e092d7680577ac75f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:17:29.005236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e17109bf-2f0f-4218-8957-eda60e1cfdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:29.015066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1284/2576] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Feb 21 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:17:29.025448 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b980ad-8217-4437-9b49-7dcb8103f89c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:17:29.036483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b980ad-8217-4437-9b49-7dcb8103f89c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:17:29.040132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:17:29.041351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:29.041627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:29.041896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:29.051738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:17:29.053194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade7371-4be4-4c56-a5a3-cbd658540d3a service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:17:29.063999 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1293/2577] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:17:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:17:43.545630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5459-5733-42d2-9bb3-c4468656cdf9 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:43.546163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5459-5733-42d2-9bb3-c4468656cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:43.546163 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5459-5733-42d2-9bb3-c4468656cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:43.564140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a3fe5459-5733-42d2-9bb3-c4468656cdf9 None None] MFA Rules not processed for user `1fc7c179028a457b93a02fa6fc440051`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:17:43.565357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a3fe5459-5733-42d2-9bb3-c4468656cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:43.572814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1285/2578] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:17:50.807203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:17:50.807784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:17:50.807784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:17:50.827850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] MFA Rules not processed for user `f5ed59d6ca96458ca507a398d0a36bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:17:50.829270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:17:50.887749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1294/2579] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:06.561263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:06.561751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:06.561844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:06.579809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:06.580980 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:06.588052 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1286/2580] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:19:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:06.627423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:06.640094 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428592fd-6261-47f6-953c-8af0d893cbf1 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:06.644895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:06.645554 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:06.645828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:06.646098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:06.653960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:06.655526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:06.663445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1295/2581] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:19:10.564612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:10.579189 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc674178-e8a7-402d-8fab-149813fdafd8 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:10.584784 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:10.585656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:10.586260 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:10.586701 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:10.588703 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:10.602951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:10.604830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3515e-1f5a-4772-a377-6eeeeae8e926 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:10.618226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1287/2582] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:19:16.266914 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:16.269001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:16.285498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd93a555-d66f-4d2f-85df-68cf676dfa02 service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:16.290845 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:16.291664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:16.292033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:16.292513 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:16.294515 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:16.307482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:16.309125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:16.321241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1296/2583] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:19:17.120145 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8f8b-3d23-452f-a699-cd5fc0425e95 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:17.120674 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8f8b-3d23-452f-a699-cd5fc0425e95 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:17.120924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a8f8b-3d23-452f-a699-cd5fc0425e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:17.140590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ae6a8f8b-3d23-452f-a699-cd5fc0425e95 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:17.141803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ae6a8f8b-3d23-452f-a699-cd5fc0425e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:17.149327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1288/2584] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:19:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:17.161352 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:17.172951 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab16081-2cb5-40ef-bc47-97223c0b3fd4 service placement] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:17.177928 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:17.178605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:17.178860 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:17.179127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:17.186790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:17.188333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:17.196046 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1297/2585] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:19:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:19:23.237751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:23.238233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:23.238351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:23.257821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:23.259000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:23.265933 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1289/2586] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:19:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:23.279076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:23.290132 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b23f-6b58-43bf-b0d6-b5af9b2efa20 service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:23.295742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:23.296395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:23.296679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:23.296956 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:23.315241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:23.317142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:23.327110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1298/2587] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 21 10:19:24.312333 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:24.347557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428245ff-bcec-4f21-94cf-bf86c28aacd0 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:24.357319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:24.358350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:24.358782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:24.359347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:24.361543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:24.456567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:24.459782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:24.472840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1290/2588] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:19:26.406258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:26.548488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8f3ec-ed03-4a2a-a544-92677534424a service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:26.554344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:26.555604 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:26.557317 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:26.557966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] PATH_INFO: `/v3/users/1c9ee5e1ede94477a87ab423b99ba8b0` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:26.559753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9ee5e1ede94477a87ab423b99ba8b0)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:26.563232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:26.663574 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9ee5e1ede94477a87ab423b99ba8b0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:26.664306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9ee5e1ede94477a87ab423b99ba8b0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:26.720654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9ee5e1ede94477a87ab423b99ba8b0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:26.740039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9ee5e1ede94477a87ab423b99ba8b0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:26.740758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9ee5e1ede94477a87ab423b99ba8b0'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:26.772983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1299/2589] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:19:26 2022] DELETE /identity/v3/users/1c9ee5e1ede94477a87ab423b99ba8b0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:27.046142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:27.065843 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4670ed-3a58-4707-88ef-f37272e5176a service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:27.177511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:27.178400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:27.178680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:27.178954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] PATH_INFO: `/v3/projects/68a2e2fa5e5645e9bf0bb37230fc6b20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:27.180130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a2e2fa5e5645e9bf0bb37230fc6b20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:27.182074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:27.243875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a2e2fa5e5645e9bf0bb37230fc6b20', 'request_id': 'req-8cf0472d-f5a4-4b3d-b064-937b550a40cf'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.253348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a2e2fa5e5645e9bf0bb37230fc6b20', 'request_id': 'req-8cf0472d-f5a4-4b3d-b064-937b550a40cf'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.262772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a2e2fa5e5645e9bf0bb37230fc6b20', 'request_id': 'req-8cf0472d-f5a4-4b3d-b064-937b550a40cf'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.279083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] The token cache is being invalidate because project 68a2e2fa5e5645e9bf0bb37230fc6b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:19:27.279402 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.280068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.281754 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1291/2590] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:19:27 2022] DELETE /identity/v3/projects/68a2e2fa5e5645e9bf0bb37230fc6b20 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:27.285674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:27.287581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:27.307064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5f9e4-dcc0-4b82-9253-e8b38635aaa4 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:27.394767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:27.395840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:27.396968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:27.397459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] PATH_INFO: `/v3/users/34ce564b93b54f43a59690a6a077eb85` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:27.398821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ce564b93b54f43a59690a6a077eb85)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:27.400979 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:27.462500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ce564b93b54f43a59690a6a077eb85'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.464018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ce564b93b54f43a59690a6a077eb85'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.477764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ce564b93b54f43a59690a6a077eb85'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.485764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ce564b93b54f43a59690a6a077eb85'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.486468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ce564b93b54f43a59690a6a077eb85'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.499501 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1300/2591] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:19:27 2022] DELETE /identity/v3/users/34ce564b93b54f43a59690a6a077eb85 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:27.749270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:27.751837 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:27.784077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0472d-f5a4-4b3d-b064-937b550a40cf admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:27.890927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:27.891844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:27.892206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:27.892550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] PATH_INFO: `/v3/projects/f402d16962ed46f489ff68ec1a192066` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:27.894037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f402d16962ed46f489ff68ec1a192066)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:27.896026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:27.961767 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f402d16962ed46f489ff68ec1a192066', 'request_id': 'req-52c8673e-baac-44ed-9bcb-a7272afae27b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.975162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f402d16962ed46f489ff68ec1a192066', 'request_id': 'req-52c8673e-baac-44ed-9bcb-a7272afae27b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.983903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f402d16962ed46f489ff68ec1a192066', 'request_id': 'req-52c8673e-baac-44ed-9bcb-a7272afae27b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:27.999708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] The token cache is being invalidate because project f402d16962ed46f489ff68ec1a192066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:19:27.999708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:28.002384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-52c8673e-baac-44ed-9bcb-a7272afae27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:28.003441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1292/2592] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:19:27 2022] DELETE /identity/v3/projects/f402d16962ed46f489ff68ec1a192066 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:41.225645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:41.227054 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:41.282794 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92d17-aae4-435d-82a3-47c5d699008a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:41.329925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:41.330596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:41.330869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:41.331137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:41.332893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:41.401530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:41.403099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:41.413675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1301/2593] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:19:46.620625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:46.621161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:46.621554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:46.643143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:46.644344 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:46.698617 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1293/2594] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:19:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:46.711678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:46.713071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:46.780862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be043bfb-9008-437c-821f-c0c9bf94325f service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:46.786152 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:46.786791 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:46.787078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:46.787355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:46.795920 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:46.797764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:46.806116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1302/2595] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:19:48.915513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:48.917028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:48.931168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665220c3-6f21-48a4-b719-bd7491722eaf None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:48.938194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:48.939330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:48.939639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:48.940000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] PATH_INFO: `/v3/users/d708a686ef8f49b69e6143c9edcfb5b4` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:48.941382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d708a686ef8f49b69e6143c9edcfb5b4)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:48.944086 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:48.990996 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd708a686ef8f49b69e6143c9edcfb5b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:48.991642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd708a686ef8f49b69e6143c9edcfb5b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:48.998371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd708a686ef8f49b69e6143c9edcfb5b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:48.999106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd708a686ef8f49b69e6143c9edcfb5b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.006210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd708a686ef8f49b69e6143c9edcfb5b4'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.022840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1294/2596] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:19:48 2022] DELETE /identity/v3/users/d708a686ef8f49b69e6143c9edcfb5b4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:49.184194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:49.197060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083725a-7dce-462b-975a-a7a28239be3a service swift] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:49.252718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:49.253629 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:49.253907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:49.254181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] PATH_INFO: `/v3/projects/80f9a8e599934ceabd6fbd2b96a626ff` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:49.255348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80f9a8e599934ceabd6fbd2b96a626ff)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:49.257947 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:49.302113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80f9a8e599934ceabd6fbd2b96a626ff', 'request_id': 'req-776ef4c1-8157-4945-b116-1ebc41691e6e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.307804 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80f9a8e599934ceabd6fbd2b96a626ff', 'request_id': 'req-776ef4c1-8157-4945-b116-1ebc41691e6e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.314509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80f9a8e599934ceabd6fbd2b96a626ff', 'request_id': 'req-776ef4c1-8157-4945-b116-1ebc41691e6e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.325563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] The token cache is being invalidate because project 80f9a8e599934ceabd6fbd2b96a626ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:19:49.325846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.326461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.327945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1303/2597] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:19:49 2022] DELETE /identity/v3/projects/80f9a8e599934ceabd6fbd2b96a626ff => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:49.331829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:49.333234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:49.345842 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f424a3-6107-41cd-b526-5d04235de447 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:49.399314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:49.400180 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:49.400465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:49.400738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] PATH_INFO: `/v3/users/8fbc68c6c1914bd890f8808d7eab78e5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:49.401935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fbc68c6c1914bd890f8808d7eab78e5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:49.403818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:49.447963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fbc68c6c1914bd890f8808d7eab78e5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.448554 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fbc68c6c1914bd890f8808d7eab78e5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.455592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fbc68c6c1914bd890f8808d7eab78e5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.456228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fbc68c6c1914bd890f8808d7eab78e5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.462986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fbc68c6c1914bd890f8808d7eab78e5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.479449 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1295/2598] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:19:49 2022] DELETE /identity/v3/users/8fbc68c6c1914bd890f8808d7eab78e5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:19:49.650503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:49.652246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:49.668145 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef4c1-8157-4945-b116-1ebc41691e6e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:49.727664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:49.728516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:49.728797 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:49.729137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] PATH_INFO: `/v3/projects/9cca52fff25344ffbd0819bf1b6ed246` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:49.730312 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cca52fff25344ffbd0819bf1b6ed246)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:49.732222 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:49.777401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cca52fff25344ffbd0819bf1b6ed246', 'request_id': 'req-b6f1f843-1f50-48c1-a00d-30b37ee360bc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.782678 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cca52fff25344ffbd0819bf1b6ed246', 'request_id': 'req-b6f1f843-1f50-48c1-a00d-30b37ee360bc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.790645 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cca52fff25344ffbd0819bf1b6ed246', 'request_id': 'req-b6f1f843-1f50-48c1-a00d-30b37ee360bc'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.801895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] The token cache is being invalidate because project 9cca52fff25344ffbd0819bf1b6ed246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:19:49.802179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.803373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:49.805166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1304/2599] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:19:49 2022] DELETE /identity/v3/projects/9cca52fff25344ffbd0819bf1b6ed246 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:49.877003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:49.878632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:49.940311 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107fc42-ecb1-472f-80a9-838e5e9fc6e0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:49.995120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:49.995724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:49.996006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:49.996279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:49.998498 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:50.062025 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:50.063441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:50.072879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1296/2600] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:19:53.017150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.018592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:53.033387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f843-1f50-48c1-a00d-30b37ee360bc admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.038636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.039516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.039796 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.040069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] PATH_INFO: `/v3/users/1fc7c179028a457b93a02fa6fc440051` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.041318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc7c179028a457b93a02fa6fc440051)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.043226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.095648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc7c179028a457b93a02fa6fc440051'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.096540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc7c179028a457b93a02fa6fc440051'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.109469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc7c179028a457b93a02fa6fc440051'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.121721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc7c179028a457b93a02fa6fc440051'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.122623 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-dcd5d437-dbe9-4a99-9e7b-dd2fd6de8db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc7c179028a457b93a02fa6fc440051'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.137241 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1305/2601] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:19:53 2022] DELETE /identity/v3/users/1fc7c179028a457b93a02fa6fc440051 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:53.318930 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.329143 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498ca03-580e-44ef-b002-099e0f3f4ee8 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.390944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.391814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.392099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.392380 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] PATH_INFO: `/v3/projects/e7c6743e7c564ff19940036bc2529184` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.393631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c6743e7c564ff19940036bc2529184)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.395543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.440717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c6743e7c564ff19940036bc2529184', 'request_id': 'req-374ded59-0132-48f0-bc23-1e6bf659f000'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.447488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c6743e7c564ff19940036bc2529184', 'request_id': 'req-374ded59-0132-48f0-bc23-1e6bf659f000'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.453679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c6743e7c564ff19940036bc2529184', 'request_id': 'req-374ded59-0132-48f0-bc23-1e6bf659f000'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.464519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] The token cache is being invalidate because project e7c6743e7c564ff19940036bc2529184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:19:53.464806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.465450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-374ded59-0132-48f0-bc23-1e6bf659f000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:19:53.466974 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1297/2602] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:19:53 2022] DELETE /identity/v3/projects/e7c6743e7c564ff19940036bc2529184 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:19:53.471869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.472181 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.472459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.490322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:53.491436 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:53.548028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1306/2603] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:53.555809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.556111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.556410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.574587 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:53.575783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:53.585014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1298/2604] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:53.588707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.598758 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617ddb2-44f4-41d8-a937-319678fb3242 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.603541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.604341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.604627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.604905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.605660 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:19:53.606088 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.607686 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.619434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1307/2605] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:19:53.624042 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.635400 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ccf46-6e55-4822-b958-cfcf7cc11263 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.640353 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.641010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.641326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.641604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.642330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.644215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.679915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1299/2606] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:19:53.683980 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.694691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0f16-dd61-47f0-a51d-7d4b0ea40b2b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.749550 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.750138 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.750417 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.750692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.751364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.753261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.773595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1308/2607] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:19:53 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:19:53.777683 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.787685 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e45a-9703-4771-b231-edeebfa5bf66 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.792248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.792891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.793216 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.793492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.794248 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.795814 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.805993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1300/2608] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:19:53.809732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.819847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82f489-080d-4ac7-8160-d8f8b3e5db2f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.824407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36429509-6541-4025-8986-e360474f514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.825037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429509-6541-4025-8986-e360474f514a admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.825344 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429509-6541-4025-8986-e360474f514a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.825615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36429509-6541-4025-8986-e360474f514a admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.826323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36429509-6541-4025-8986-e360474f514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.827869 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36429509-6541-4025-8986-e360474f514a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.837803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1309/2609] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:19:53.841841 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.851562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ccfc6-4cb0-4269-8b34-e8b1aafacaa3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:53.856119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:53.856973 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.857285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.857555 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] PATH_INFO: `/v3/projects/57cfaed8cc17461db3ae0fe21e78e681/users/70d5c48c93f347e4b62aa43592427bf9/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.873081 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cfaed8cc17461db3ae0fe21e78e681, user_id=70d5c48c93f347e4b62aa43592427bf9, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:53.875710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:53.888456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1301/2610] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:19:53 2022] PUT /identity/v3/projects/57cfaed8cc17461db3ae0fe21e78e681/users/70d5c48c93f347e4b62aa43592427bf9/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:19:53.898488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:53.898778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:53.899059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:53.924430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] MFA Rules not processed for user `70d5c48c93f347e4b62aa43592427bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:19:53.925716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:53.986765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1310/2611] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:19:53.997972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:19:53.999781 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:19:54.069561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c734-d3d9-43c6-b733-a90222e0bb5e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:19:54.075101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:19:54.075735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:19:54.076021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:19:54.076295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:19:54.083748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:19:54.085321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299467d-ad95-41b6-9108-24086587a2e9 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:19:54.094989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1302/2612] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:02.295202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:02.354089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc7d8c-4c87-40a8-8a73-7e888b8f136a None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:02.358518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:02.359393 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:02.359673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:02.359945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] PATH_INFO: `/v3/users/70d5c48c93f347e4b62aa43592427bf9` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:02.361125 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d5c48c93f347e4b62aa43592427bf9)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:02.363003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:02.406493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d5c48c93f347e4b62aa43592427bf9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.407210 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d5c48c93f347e4b62aa43592427bf9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.419091 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d5c48c93f347e4b62aa43592427bf9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.425734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d5c48c93f347e4b62aa43592427bf9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.426338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d5c48c93f347e4b62aa43592427bf9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.438502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1311/2613] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:02 2022] DELETE /identity/v3/users/70d5c48c93f347e4b62aa43592427bf9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:02.443170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:02.443657 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:02.443780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:02.460327 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:02.461546 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:02.517580 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1303/2614] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:02.527212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:02.528577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:02.582786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c268e11-6c1c-4a46-ae7f-4ec9e9bd8a2d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:02.586423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:02.587044 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:02.587324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:02.587596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:02.596306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:02.597751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790e633-c7d8-48ba-adcf-ea9d9498b82a service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:02.607381 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1312/2615] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:02.857289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:02.858923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:02.872862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88a14a-d0a3-4eaa-bc9a-a58a73207360 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:02.878119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:02.879195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:02.879483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:02.879763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] PATH_INFO: `/v3/projects/57cfaed8cc17461db3ae0fe21e78e681` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:02.881229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cfaed8cc17461db3ae0fe21e78e681)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:02.883110 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:02.929124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cfaed8cc17461db3ae0fe21e78e681', 'request_id': 'req-c522d4fc-7f74-4738-8535-eec26252130c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.935809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cfaed8cc17461db3ae0fe21e78e681', 'request_id': 'req-c522d4fc-7f74-4738-8535-eec26252130c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.941906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cfaed8cc17461db3ae0fe21e78e681', 'request_id': 'req-c522d4fc-7f74-4738-8535-eec26252130c'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.952043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] The token cache is being invalidate because project 57cfaed8cc17461db3ae0fe21e78e681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:02.952332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.952967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c522d4fc-7f74-4738-8535-eec26252130c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:02.954519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1304/2616] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:02 2022] DELETE /identity/v3/projects/57cfaed8cc17461db3ae0fe21e78e681 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:02.959921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:02.960209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:02.960485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:02.978354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:02.979570 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:03.035337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1313/2617] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:03.044542 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.044834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.045152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.062981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:03.064177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:03.072857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1305/2618] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:03.076915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.087039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959d674-8588-4cf8-99ca-fb41e24bda77 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.092740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.093442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.093722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.093997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.094723 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:20:03.095001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.096636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.108730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1314/2619] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:20:03.113557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.124033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab4681-36c1-41fa-b914-6ac857c7f740 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.128797 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.129471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.129756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.130534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.131322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.133254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.158446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1306/2620] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:03.162305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.172167 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21978df-137e-4d6b-b1e2-89bbf23398e2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.227343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.227998 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.228279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.228553 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.229261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.231192 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.250227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1315/2621] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:03.254338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.264941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773599d5-a921-4422-bec7-a0ea509b4164 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.269645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.270297 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.271176 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.271462 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.272187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.273868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.284058 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1307/2622] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:03.288174 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.297744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5295c81-4fce-41e6-ac50-80c18ed408a2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.302295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.302921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.303194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.303462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.304175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.305762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b30ee-e622-46b4-a71f-4c046ffb7bf5 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.315169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1316/2623] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:03.319623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.329289 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c980d7-65ac-489f-ad6d-6fc1ff103f27 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.334553 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.335417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.335733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.336007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] PATH_INFO: `/v3/projects/3dbaa2ea4a00408cae24c4ab5a710f9c/users/3b8b4947a2734f24b10eeb33b4ab0509/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.351207 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dbaa2ea4a00408cae24c4ab5a710f9c, user_id=3b8b4947a2734f24b10eeb33b4ab0509, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.353909 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.366938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1308/2624] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:03 2022] PUT /identity/v3/projects/3dbaa2ea4a00408cae24c4ab5a710f9c/users/3b8b4947a2734f24b10eeb33b4ab0509/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:03.377721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.378012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.378286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.404591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] MFA Rules not processed for user `3b8b4947a2734f24b10eeb33b4ab0509`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:03.405834 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:03.467975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1317/2625] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:03.472408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.530317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6a664-4f37-4323-adf2-5b19227b9aa3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.535459 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.536126 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.536408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.536681 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.537436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.539317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.564678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1309/2626] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:03.568458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.578751 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f681c8-d4bb-424d-a87b-381145917d07 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.631150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.631754 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.632029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.632297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.632965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.634887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.653522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1318/2627] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/users => generated 299 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:20:03.657619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.667602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052aff9d-1dc8-42b7-b181-ebe2b329c049 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.672274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.672924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.673234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.673513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.674235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.675809 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.686450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1310/2628] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:03.690441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.700617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52721d9-65cb-4343-9809-1a505bbf12b0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.705933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.706789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.707068 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.707340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] PATH_INFO: `/v3/projects/019c00bc1c9f4024a58f089b77577401/users/d26d8aa84e084959a5c38acd4e5209b2/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.721256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c00bc1c9f4024a58f089b77577401, user_id=d26d8aa84e084959a5c38acd4e5209b2, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.723885 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.736123 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1319/2629] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:03 2022] PUT /identity/v3/projects/019c00bc1c9f4024a58f089b77577401/users/d26d8aa84e084959a5c38acd4e5209b2/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:20:03.740550 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.750601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dec746-a94d-4b8d-804f-6747d9095586 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.803968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.804627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.804906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.805213 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.805923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.807496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3750fd-f492-47d8-884d-bc154c8ab95b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.816927 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1311/2630] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:03.821464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.831188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a8ada-daa5-4fb5-9049-ba80aeb97349 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:03.835651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:03.836564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.836840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.837141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] PATH_INFO: `/v3/projects/019c00bc1c9f4024a58f089b77577401/users/d26d8aa84e084959a5c38acd4e5209b2/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.839049 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c00bc1c9f4024a58f089b77577401, user_id=d26d8aa84e084959a5c38acd4e5209b2, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:03.841635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:03.851620 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1320/2631] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:03 2022] PUT /identity/v3/projects/019c00bc1c9f4024a58f089b77577401/users/d26d8aa84e084959a5c38acd4e5209b2/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:03.861407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:03.861699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:03.861975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:03.888478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] MFA Rules not processed for user `d26d8aa84e084959a5c38acd4e5209b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:03.889640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:03.953822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1312/2632] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:03.963643 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:03.965360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:04.018806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770b29-976d-4d65-945d-67d0480ab30c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:04.022452 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:04.023071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.023345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.023615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.032133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:04.033564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4ef1-95ad-4007-a2a1-9e3cbc8a4631 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:04.042978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1321/2633] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:04.071157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:04.132593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d45e6a-7eba-4239-b624-98844527aa3e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:04.137483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:04.138338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.138666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.138890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] PATH_INFO: `/v3/users/3b8b4947a2734f24b10eeb33b4ab0509` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.140066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8b4947a2734f24b10eeb33b4ab0509)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:04.141984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:04.185966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8b4947a2734f24b10eeb33b4ab0509'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.186630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8b4947a2734f24b10eeb33b4ab0509'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.194699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8b4947a2734f24b10eeb33b4ab0509'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.195328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8b4947a2734f24b10eeb33b4ab0509'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.201972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8b4947a2734f24b10eeb33b4ab0509'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.219288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1313/2634] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:04 2022] DELETE /identity/v3/users/3b8b4947a2734f24b10eeb33b4ab0509 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:04.223861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.224146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.224422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.242033 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:04.243201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:04.299064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1322/2635] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:04.309282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:04.310690 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:04.365332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec7f4f-ea28-4b34-a3f9-56e608b4ac36 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:04.369014 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:04.369663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.369947 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.370223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.379308 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:04.381358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:04.390519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1314/2636] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:04.649430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:04.650862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:04.664491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236db7e2-d086-4393-bb54-eb67b5667b5f None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:04.669127 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:04.670429 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.670714 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.670985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] PATH_INFO: `/v3/projects/3dbaa2ea4a00408cae24c4ab5a710f9c` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.672285 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dbaa2ea4a00408cae24c4ab5a710f9c)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:04.674355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:04.728361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dbaa2ea4a00408cae24c4ab5a710f9c', 'request_id': 'req-b8e618c0-44b3-434d-be49-192c855edc7d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.733592 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dbaa2ea4a00408cae24c4ab5a710f9c', 'request_id': 'req-b8e618c0-44b3-434d-be49-192c855edc7d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.740826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dbaa2ea4a00408cae24c4ab5a710f9c', 'request_id': 'req-b8e618c0-44b3-434d-be49-192c855edc7d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.751771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] The token cache is being invalidate because project 3dbaa2ea4a00408cae24c4ab5a710f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:04.752057 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.752675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.754201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1323/2637] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:04 2022] DELETE /identity/v3/projects/3dbaa2ea4a00408cae24c4ab5a710f9c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:04.758210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:04.767619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061abc-8f92-4ceb-a5b9-2bab59769a7a service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:04.821652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:04.822514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:04.822792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:04.823061 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] PATH_INFO: `/v3/users/d26d8aa84e084959a5c38acd4e5209b2` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:04.824238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26d8aa84e084959a5c38acd4e5209b2)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:04.826173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:04.868863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26d8aa84e084959a5c38acd4e5209b2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.869609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26d8aa84e084959a5c38acd4e5209b2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.876375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26d8aa84e084959a5c38acd4e5209b2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.876982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26d8aa84e084959a5c38acd4e5209b2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.883885 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-17b8e306-398a-4151-953d-1e1a2cb67bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26d8aa84e084959a5c38acd4e5209b2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:04.900158 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1315/2638] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:04 2022] DELETE /identity/v3/users/d26d8aa84e084959a5c38acd4e5209b2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:05.156171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.157694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:05.173410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e618c0-44b3-434d-be49-192c855edc7d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.229364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.230201 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.230479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.230749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] PATH_INFO: `/v3/projects/019c00bc1c9f4024a58f089b77577401` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.231900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] RBAC: Authorizing `identity:delete_project(project_id=019c00bc1c9f4024a58f089b77577401)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.233818 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.276960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019c00bc1c9f4024a58f089b77577401', 'request_id': 'req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:05.282280 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019c00bc1c9f4024a58f089b77577401', 'request_id': 'req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:05.289912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019c00bc1c9f4024a58f089b77577401', 'request_id': 'req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:05.300246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] The token cache is being invalidate because project 019c00bc1c9f4024a58f089b77577401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:05.300846 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:05.301221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-c607d5ce-7d11-4bb1-a64c-7e6abe84899a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:05.302996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1324/2639] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:05 2022] DELETE /identity/v3/projects/019c00bc1c9f4024a58f089b77577401 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:05.307851 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.308139 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.308443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.326288 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:05.327473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:05.385379 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1316/2640] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:05.394278 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.394565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.394867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.413543 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:05.414601 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:05.422771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1325/2641] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:05.427034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.436365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3da903-4c0c-4bcc-803b-bb4e4562d91c None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.440892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.441564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.441850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.442120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.443345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:20:05.443647 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.445318 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.456279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1317/2642] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:20:05.460478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.469847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce34c7-3102-4e2a-8e0f-a4b7d0f66312 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.474566 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.475225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.475500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.475795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.476478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.478360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.502701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1326/2643] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:05.507464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.516999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25eb84-44fc-42cf-879d-66a48517ad25 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.570699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.571365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.571652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.571924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.572604 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.574517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.594236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1318/2644] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:05.598411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.608248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b6dd-21a3-4696-bfa0-0bf0310b646f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.612937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.613603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.613880 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.614182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.614893 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.616443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.627727 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1327/2645] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:05.631988 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.641819 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e34f1d-428a-4242-8d63-d28d23474e44 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.647040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.647693 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.647978 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.648269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.648976 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.650584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d653c1b-4238-4522-b122-99d0b644f2dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.660503 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1319/2646] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:05.664817 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.678060 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1376-4c1c-47a1-92d3-528fcd8edc17 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.682843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.684203 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.684483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.684756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] PATH_INFO: `/v3/projects/4b9edfbb00c6405bbc276cd371302ba3/users/03ce64a520ab4fb28e46a052187a0b13/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.702494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9edfbb00c6405bbc276cd371302ba3, user_id=03ce64a520ab4fb28e46a052187a0b13, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.705098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.718835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1328/2647] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:05 2022] PUT /identity/v3/projects/4b9edfbb00c6405bbc276cd371302ba3/users/03ce64a520ab4fb28e46a052187a0b13/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:05.729417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278f5c-f043-4485-8817-57805c864e02 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.729705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278f5c-f043-4485-8817-57805c864e02 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.729982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be278f5c-f043-4485-8817-57805c864e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.756505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-be278f5c-f043-4485-8817-57805c864e02 None None] MFA Rules not processed for user `03ce64a520ab4fb28e46a052187a0b13`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:05.757730 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-be278f5c-f043-4485-8817-57805c864e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:05.818153 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1320/2648] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:05.822576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.882575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec08c9-c57b-41eb-a68f-1b81bd09d28a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.887235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.888008 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.888288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.888559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.889260 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.891117 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:05.916688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1329/2649] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:05.920411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278f5c-f043-4485-8817-57805c864e02 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:05.932595 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be278f5c-f043-4485-8817-57805c864e02 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:05.985931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:05.986596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:05.986878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:05.987147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:05.987823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:05.990519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.009889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1321/2650] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:05 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:06.013837 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.023832 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2e216-568b-44a8-b6ae-4f8468c0080b admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.028492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.029164 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.029445 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.029720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.030462 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.032036 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.046583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1330/2651] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:06.051196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.061530 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82df1-2ae0-40db-a388-8a9724fbe48c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.066167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.067066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.067984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.068271 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] PATH_INFO: `/v3/projects/f7efa1e5a4134559ac95674df9b2953b/users/29d3cf207c004bd5a5f6f88ae78413b5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.082446 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7efa1e5a4134559ac95674df9b2953b, user_id=29d3cf207c004bd5a5f6f88ae78413b5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.085049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.098209 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1322/2652] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:06 2022] PUT /identity/v3/projects/f7efa1e5a4134559ac95674df9b2953b/users/29d3cf207c004bd5a5f6f88ae78413b5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:06.102172 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.111692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d485fb-2fe8-4383-a0f3-d78d387ce44f admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.166851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.167430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.167710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.167982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.168721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.170334 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f63c2d-c76b-4886-9396-40f780d2e2aa admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.180269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1331/2653] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:06.184565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.196774 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6ca7-69a8-45a9-a4b7-8af9d53eba30 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.201606 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.202480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.202757 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.203027 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] PATH_INFO: `/v3/projects/f7efa1e5a4134559ac95674df9b2953b/users/29d3cf207c004bd5a5f6f88ae78413b5/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.205295 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7efa1e5a4134559ac95674df9b2953b, user_id=29d3cf207c004bd5a5f6f88ae78413b5, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.208026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.218394 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1323/2654] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:06 2022] PUT /identity/v3/projects/f7efa1e5a4134559ac95674df9b2953b/users/29d3cf207c004bd5a5f6f88ae78413b5/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:06.229150 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279740-919b-43b0-b7be-142275818d26 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.229439 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279740-919b-43b0-b7be-142275818d26 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.229718 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff279740-919b-43b0-b7be-142275818d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.256026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-ff279740-919b-43b0-b7be-142275818d26 None None] MFA Rules not processed for user `29d3cf207c004bd5a5f6f88ae78413b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:06.257251 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-ff279740-919b-43b0-b7be-142275818d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:06.320903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1332/2655] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:20:06.330214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.331886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:06.387355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7dc7e-5ba0-4f44-ac54-4fe80c61549f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.391022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.391656 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.391943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.392220 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.400951 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.402383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.411982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1324/2656] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:20:06.503341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279740-919b-43b0-b7be-142275818d26 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:06.512687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff279740-919b-43b0-b7be-142275818d26 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:06.516287 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:06.516911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:06.517227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:06.517502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:06.570819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:06.572235 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c064f4-d4d3-4d67-81e3-ab9b72cc5d5a service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:06.580697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1333/2657] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:09.092468 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:09.152966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191497c1-d33a-4c88-abad-dc7d5048bb43 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:09.157524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:09.158374 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:09.158652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:09.158926 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] PATH_INFO: `/v3/users/03ce64a520ab4fb28e46a052187a0b13` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:09.160088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=03ce64a520ab4fb28e46a052187a0b13)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:09.162016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:09.208778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03ce64a520ab4fb28e46a052187a0b13'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.209471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03ce64a520ab4fb28e46a052187a0b13'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.216901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03ce64a520ab4fb28e46a052187a0b13'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.217556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03ce64a520ab4fb28e46a052187a0b13'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.224238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03ce64a520ab4fb28e46a052187a0b13'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.240302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1325/2658] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:09 2022] DELETE /identity/v3/users/03ce64a520ab4fb28e46a052187a0b13 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:09.244844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:09.245340 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:09.245458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:09.262460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:09.263644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:09.318026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1334/2659] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:09.327823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:09.329286 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:09.383618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0f40-e670-4b00-825a-b23ee38a1dfc admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:09.387208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:09.387838 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:09.388117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:09.388389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:09.397699 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:09.399130 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:09.408133 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1326/2660] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:09.680948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:09.682382 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:09.694530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a262-a013-43a8-b761-e2ee0c662bb7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:09.699296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:09.700141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:09.700422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:09.700697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] PATH_INFO: `/v3/projects/4b9edfbb00c6405bbc276cd371302ba3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:09.701974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9edfbb00c6405bbc276cd371302ba3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:09.703871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:09.749854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9edfbb00c6405bbc276cd371302ba3', 'request_id': 'req-befde467-115a-48c3-8e40-46ffb43c05a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.755106 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9edfbb00c6405bbc276cd371302ba3', 'request_id': 'req-befde467-115a-48c3-8e40-46ffb43c05a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.761954 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9edfbb00c6405bbc276cd371302ba3', 'request_id': 'req-befde467-115a-48c3-8e40-46ffb43c05a9'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.773401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] The token cache is being invalidate because project 4b9edfbb00c6405bbc276cd371302ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:09.773680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.774286 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.775813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1335/2661] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:09 2022] DELETE /identity/v3/projects/4b9edfbb00c6405bbc276cd371302ba3 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:09.780003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:09.790210 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52d9f7-8357-49c0-9d11-f16adfd5718b service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:09.843310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:09.844099 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:09.844372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:09.844641 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] PATH_INFO: `/v3/users/29d3cf207c004bd5a5f6f88ae78413b5` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:09.845821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d3cf207c004bd5a5f6f88ae78413b5)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:09.847917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:09.898935 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d3cf207c004bd5a5f6f88ae78413b5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.899600 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d3cf207c004bd5a5f6f88ae78413b5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.906590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d3cf207c004bd5a5f6f88ae78413b5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.907321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d3cf207c004bd5a5f6f88ae78413b5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.914066 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-70fc536e-a9ad-4930-99a4-6873e50f2963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d3cf207c004bd5a5f6f88ae78413b5'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:09.930602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1327/2662] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:09 2022] DELETE /identity/v3/users/29d3cf207c004bd5a5f6f88ae78413b5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:20:10.191030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.192960 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:10.205939 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befde467-115a-48c3-8e40-46ffb43c05a9 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.262211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.263061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.263341 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.263613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] PATH_INFO: `/v3/projects/f7efa1e5a4134559ac95674df9b2953b` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.264766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7efa1e5a4134559ac95674df9b2953b)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.266667 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.310198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7efa1e5a4134559ac95674df9b2953b', 'request_id': 'req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:10.315247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7efa1e5a4134559ac95674df9b2953b', 'request_id': 'req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:10.322158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7efa1e5a4134559ac95674df9b2953b', 'request_id': 'req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:10.332865 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] The token cache is being invalidate because project f7efa1e5a4134559ac95674df9b2953b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:10.333679 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:10.334322 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-5b7d8154-eb9a-4c51-bdf5-827dd44a136a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:10.335805 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1336/2663] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:10 2022] DELETE /identity/v3/projects/f7efa1e5a4134559ac95674df9b2953b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:20:10.340658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.341160 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.341254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.360672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:10.361825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:10.418315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1328/2664] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:10.425975 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.426265 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.426541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.445633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:10.446828 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:10.454695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1337/2665] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:10.459229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.468427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100548-cf40-4f63-a7ab-74744e2bcd7e None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.472886 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.473678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.474463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.474732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.475434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:20:10.475733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.477322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.488281 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1329/2666] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:20:10.492509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.501736 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199747a4-8334-41bb-a086-ff95ef9edf24 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.506400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.507056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.507362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.507665 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.508348 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.510240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.534671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1338/2667] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:20:10.539471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.549131 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28297f78-3395-4da1-8be3-dfbda544db9b admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.603146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.603808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.604085 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.604354 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.605038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.606963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.625572 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1330/2668] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:10.629746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.640361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8060e40-b7e9-4c20-9cf8-2395e5d4c4e7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.644966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.646211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.646491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.646763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.647481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.649031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.659137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1339/2669] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:10.662811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.672161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a165ffb-76d5-4546-b1e0-c9f8ff49281c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.676741 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.677416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.677698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.677968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.678675 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.680395 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d2b3d-e1ec-4b3d-81da-31d078c753e4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.689878 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1331/2670] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:10.694379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.703987 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa75dd5-0998-4c04-bf85-001c161b5d34 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.709157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.710005 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.710284 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.710561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] PATH_INFO: `/v3/projects/76f64767e26949a79a1a49f827088767/users/9086b4fb0d2044acafa662c5df487784/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.724242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f64767e26949a79a1a49f827088767, user_id=9086b4fb0d2044acafa662c5df487784, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.726896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.739471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1340/2671] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:10 2022] PUT /identity/v3/projects/76f64767e26949a79a1a49f827088767/users/9086b4fb0d2044acafa662c5df487784/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:10.749890 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.750177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.750478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.776705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] MFA Rules not processed for user `9086b4fb0d2044acafa662c5df487784`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:10.777936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:10.837551 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1332/2672] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:10.841955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.900708 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bb30d-7768-4767-822c-3ee6ea8018b7 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:10.905389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:10.906050 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:10.906337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:10.906612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:10.907297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:10.909219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:10.933353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1341/2673] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:20:10.937625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:10.948445 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ed5f-903a-4c85-a2e6-2b4f07df49fa None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.002636 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.003298 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.003582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.003860 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.004539 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.007062 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.026578 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1333/2674] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:10 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:11.030551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.041473 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40c9d-7f23-4e5e-9087-2719fe5b0294 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.046099 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.046740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.047018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.047290 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.048034 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.049638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.059742 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1342/2675] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:11.063557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.073214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1297825-0565-40aa-84d9-6e5f0d662050 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.077816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.078452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.078729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.078999 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.079707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.081602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de20f1-c0c4-4765-82a3-9d0ddb2a1d9f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.091867 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1334/2676] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:11.096160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.106449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8067ee-8046-420b-a411-2e99b13af0a2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.111064 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.111929 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.112208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.112479 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] PATH_INFO: `/v3/projects/6a522d113bad49878a017638c79340e1/users/211d550f3d9643659cb7890426f6d333/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.126618 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a522d113bad49878a017638c79340e1, user_id=211d550f3d9643659cb7890426f6d333, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.129247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.142500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1343/2677] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:11 2022] PUT /identity/v3/projects/6a522d113bad49878a017638c79340e1/users/211d550f3d9643659cb7890426f6d333/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:11.154102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.154330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.154605 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.180481 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] MFA Rules not processed for user `211d550f3d9643659cb7890426f6d333`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:11.181954 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:11.243869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1335/2678] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:11.248705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.311576 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84853a52-8ab1-4f3d-a470-26d3f18886fd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.317204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.318657 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.318943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.319218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.319913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.321840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.346013 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1344/2679] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:11.350667 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.360967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760950a-498e-40c9-9d22-abbc266ce77f None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.417100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.417749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.418030 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.418302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.418994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.420929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.440464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1336/2680] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:11 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:11.444615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.454712 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a64b-36bc-4a95-ba36-416fcb4972e8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.459530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.460185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.460465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.460738 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.461593 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.463166 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.474410 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1345/2681] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:11.478603 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.488470 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59cf9e-9904-4d89-9b30-9c47ba8c91ea admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.493633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.494491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.494770 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.495041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] PATH_INFO: `/v3/projects/dcac82a126454170b04a43408e7247bf/users/01e3138025de4176ad35f05361adf96b/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.509167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac82a126454170b04a43408e7247bf, user_id=01e3138025de4176ad35f05361adf96b, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.511748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.524495 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1337/2682] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:11 2022] PUT /identity/v3/projects/dcac82a126454170b04a43408e7247bf/users/01e3138025de4176ad35f05361adf96b/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:20:11.528483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.538726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4096851-451f-4523-a7b2-71a8e3161799 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.593337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.594003 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.594335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.594615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.595332 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.596907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6548be6-e2c1-4757-b1f5-8756636104ae admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.608481 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1346/2683] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:11.612714 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.623487 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a683e-05b0-4114-bba2-1af61871c025 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.628097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.628963 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.629268 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.629541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] PATH_INFO: `/v3/projects/dcac82a126454170b04a43408e7247bf/users/01e3138025de4176ad35f05361adf96b/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.631561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcac82a126454170b04a43408e7247bf, user_id=01e3138025de4176ad35f05361adf96b, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.634205 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.643961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1338/2684] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:11 2022] PUT /identity/v3/projects/dcac82a126454170b04a43408e7247bf/users/01e3138025de4176ad35f05361adf96b/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:11.654011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.654298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.654577 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.680687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] MFA Rules not processed for user `01e3138025de4176ad35f05361adf96b`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:11.681842 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:11.745209 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1347/2685] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:11.755329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.757011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:11.811577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31c22a-7486-456e-a8d1-ab40e2629af8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.815252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.815884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.816167 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.816443 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.825149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.826552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.836125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1339/2686] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:11.875669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:11.877168 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:11.889165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3f2aa-41b2-4073-ab8c-22cb027fceac None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:11.892823 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:11.893494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:11.893774 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:11.894048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:11.948345 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:11.949719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe42a6-2d20-4e19-b8ec-840e6ff2a6ec service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:11.958800 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1348/2687] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:14.758332 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:14.817078 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4201608-338b-41aa-b027-0a494c8a8927 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:14.822125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:14.822975 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:14.823250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:14.823520 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] PATH_INFO: `/v3/users/9086b4fb0d2044acafa662c5df487784` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:14.824663 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9086b4fb0d2044acafa662c5df487784)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:14.826567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:14.870815 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9086b4fb0d2044acafa662c5df487784'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:14.871450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9086b4fb0d2044acafa662c5df487784'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:14.878732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9086b4fb0d2044acafa662c5df487784'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:14.879338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9086b4fb0d2044acafa662c5df487784'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:14.887038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9086b4fb0d2044acafa662c5df487784'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:14.903296 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1340/2688] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:14 2022] DELETE /identity/v3/users/9086b4fb0d2044acafa662c5df487784 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:14.908026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:14.908499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:14.908847 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:14.925480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:14.927162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:14.983607 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1349/2689] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:14.993821 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:14.995193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:15.180111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4256f2-24af-4e40-ac1a-b4b2a5ffffc3 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:15.183700 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:15.184339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:15.184619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:15.184893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:15.193773 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:15.195174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:15.204371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1341/2690] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:15.464917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:15.466343 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:15.478551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d93ade-6bc6-4def-87d9-14bc4b69ec59 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:15.483128 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:15.483965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:15.484245 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:15.484511 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] PATH_INFO: `/v3/projects/76f64767e26949a79a1a49f827088767` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:15.485726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f64767e26949a79a1a49f827088767)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:15.488115 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:15.533484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f64767e26949a79a1a49f827088767', 'request_id': 'req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.539431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f64767e26949a79a1a49f827088767', 'request_id': 'req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.546276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f64767e26949a79a1a49f827088767', 'request_id': 'req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.556492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] The token cache is being invalidate because project 76f64767e26949a79a1a49f827088767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:15.556771 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.557411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.558902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1350/2691] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:15 2022] DELETE /identity/v3/projects/76f64767e26949a79a1a49f827088767 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:15.562946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:15.572564 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d81b-8ee9-4363-8e23-9f234376ff6a service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:15.627476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:15.628325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:15.628602 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:15.628870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] PATH_INFO: `/v3/users/211d550f3d9643659cb7890426f6d333` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:15.630193 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211d550f3d9643659cb7890426f6d333)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:15.632084 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:15.675115 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211d550f3d9643659cb7890426f6d333'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.675759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211d550f3d9643659cb7890426f6d333'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.683080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211d550f3d9643659cb7890426f6d333'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.683691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211d550f3d9643659cb7890426f6d333'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.690302 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211d550f3d9643659cb7890426f6d333'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:15.706567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1342/2692] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:15 2022] DELETE /identity/v3/users/211d550f3d9643659cb7890426f6d333 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:15.966225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:15.968053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:15.972825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:15.974747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:15.994925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c15d3-f528-4a7b-aa57-5e6399fb6d5d admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.031874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c1c7-aca3-4d5a-a4f7-e9b94f6380c5 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.035424 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.036069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.036349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.036622 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.038476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:16.050059 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.050836 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.051116 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.051389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] PATH_INFO: `/v3/projects/6a522d113bad49878a017638c79340e1` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.052561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a522d113bad49878a017638c79340e1)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.054461 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.096179 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.097633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.099773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a522d113bad49878a017638c79340e1', 'request_id': 'req-3f3671db-e049-4345-9b0a-c4df6f06a251'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.105249 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a522d113bad49878a017638c79340e1', 'request_id': 'req-3f3671db-e049-4345-9b0a-c4df6f06a251'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.106584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1343/2693] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:20:16.112755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a522d113bad49878a017638c79340e1', 'request_id': 'req-3f3671db-e049-4345-9b0a-c4df6f06a251'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.124178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] The token cache is being invalidate because project 6a522d113bad49878a017638c79340e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:16.124580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.125337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.130463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1351/2694] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:15 2022] DELETE /identity/v3/projects/6a522d113bad49878a017638c79340e1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:16.131652 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:16.133255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:16.146943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23963da-4538-4318-a198-4f83070c0726 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.210661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.211565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.211846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.212116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] PATH_INFO: `/v3/users/01e3138025de4176ad35f05361adf96b` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.213351 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e3138025de4176ad35f05361adf96b)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.215238 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.262958 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e3138025de4176ad35f05361adf96b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.263370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e3138025de4176ad35f05361adf96b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.272586 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e3138025de4176ad35f05361adf96b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.273427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e3138025de4176ad35f05361adf96b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.281694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b5011326-9083-441c-9e67-0491a2b3f66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e3138025de4176ad35f05361adf96b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.299532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1344/2695] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:16 2022] DELETE /identity/v3/users/01e3138025de4176ad35f05361adf96b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:16.561272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:16.562766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:16.575968 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3671db-e049-4345-9b0a-c4df6f06a251 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.633171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.634012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.634288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.634588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] PATH_INFO: `/v3/projects/dcac82a126454170b04a43408e7247bf` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.635772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcac82a126454170b04a43408e7247bf)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.637698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.687584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcac82a126454170b04a43408e7247bf', 'request_id': 'req-1894b9dd-5920-479b-a9cf-3d876ba37f82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.693458 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcac82a126454170b04a43408e7247bf', 'request_id': 'req-1894b9dd-5920-479b-a9cf-3d876ba37f82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.700375 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcac82a126454170b04a43408e7247bf', 'request_id': 'req-1894b9dd-5920-479b-a9cf-3d876ba37f82'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.711491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] The token cache is being invalidate because project dcac82a126454170b04a43408e7247bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:16.711772 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.712419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-1894b9dd-5920-479b-a9cf-3d876ba37f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:16.713963 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1352/2696] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:16 2022] DELETE /identity/v3/projects/dcac82a126454170b04a43408e7247bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:16.719903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.720208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.720486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.738463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:16.740276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:16.794476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1345/2697] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:16.803404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.803693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.804019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.821416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:16.822575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:16.830232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1353/2698] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:16.834217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:16.843874 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be0a42-115b-4be2-8e41-e0b27e2692e3 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.848378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.849560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.849891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.850162 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.850870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:20:16.851172 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.852722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.863875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1346/2699] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:20:16.868747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:16.878026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65e187-8834-44cf-96cd-7cb2c3a64bbd None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.882588 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.883223 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.883502 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.883776 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.884449 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.886324 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:16.910362 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1354/2700] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:16 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:16.915149 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:16.925072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f9894-94f3-442d-9f83-90f39d3b64e0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:16.978369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:16.979022 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:16.979300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:16.979577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:16.980269 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:16.982236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:17.002251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1347/2701] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:16 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:17.006311 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:17.016226 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eaef3c-5664-4722-ac00-0a230e6f767c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:17.021506 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:17.022147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:17.022422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:17.022692 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:17.023400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:17.024955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:17.035141 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1355/2702] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:17.039541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:17.048917 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b589-c314-4763-af9a-8b0146af32ce admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:17.053511 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:17.054253 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:17.054480 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:17.054748 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:17.055452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:17.057003 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920a22b-0f4e-407a-a0bd-aef2ad2d2b1d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:17.066384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1348/2703] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:17.070097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:17.079684 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51871fc3-6bdd-44d5-8c69-b8be8c73dbc6 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:17.084783 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:17.085666 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:17.085943 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:17.086237 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] PATH_INFO: `/v3/projects/dca2dd2081f4473c8460c8399e49f9a3/users/d1c93a12b4bc423f8d819bd75cbe5730/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:17.101227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca2dd2081f4473c8460c8399e49f9a3, user_id=d1c93a12b4bc423f8d819bd75cbe5730, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:17.103840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:17.116262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1356/2704] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:17 2022] PUT /identity/v3/projects/dca2dd2081f4473c8460c8399e49f9a3/users/d1c93a12b4bc423f8d819bd75cbe5730/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:17.128719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653e1b-dad3-444d-8b40-d68fda67ee81 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:17.129006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653e1b-dad3-444d-8b40-d68fda67ee81 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:17.129315 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653e1b-dad3-444d-8b40-d68fda67ee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:17.156070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f5653e1b-dad3-444d-8b40-d68fda67ee81 None None] MFA Rules not processed for user `d1c93a12b4bc423f8d819bd75cbe5730`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:17.157384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f5653e1b-dad3-444d-8b40-d68fda67ee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:17.217141 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1349/2705] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:17.228850 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:17.230605 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:17.283944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6f7b2-cf18-4a2c-a535-4f2bf4fc2963 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:17.288301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e0131ca364c4f3c98aa0f49f6013a94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:17.288931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:17.289242 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:17.289518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:17.297923 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:17.299364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:17.308529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1357/2706] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:28.154921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7abf3-161c-4d70-be8b-1a7c37387af0 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:28.155408 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7abf3-161c-4d70-be8b-1a7c37387af0 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:28.155524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7abf3-161c-4d70-be8b-1a7c37387af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:28.175879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-18f7abf3-161c-4d70-be8b-1a7c37387af0 None None] MFA Rules not processed for user `f5ed59d6ca96458ca507a398d0a36bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:28.177080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-18f7abf3-161c-4d70-be8b-1a7c37387af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:28.232688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1350/2707] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:44.182195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:44.240089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0f890-6690-4e7f-ad1c-90bf5ab2b238 service glance] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:44.245234 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:44.246078 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:44.246353 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:44.246873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] PATH_INFO: `/v3/users/d1c93a12b4bc423f8d819bd75cbe5730` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:44.248039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c93a12b4bc423f8d819bd75cbe5730)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:44.249989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:44.293101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c93a12b4bc423f8d819bd75cbe5730'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.293734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c93a12b4bc423f8d819bd75cbe5730'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.304532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c93a12b4bc423f8d819bd75cbe5730'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.311476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c93a12b4bc423f8d819bd75cbe5730'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.312101 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c93a12b4bc423f8d819bd75cbe5730'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.323630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1358/2708] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:20:44 2022] DELETE /identity/v3/users/d1c93a12b4bc423f8d819bd75cbe5730 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:44.328076 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:44.328567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:44.328687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:44.345707 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:44.346804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:44.401704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1351/2709] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:44.411160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:44.412559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:44.470373 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d948d5d-8a7c-4860-836e-28966fe8b58e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:44.473978 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:44.474600 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:44.474875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:44.475142 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:44.484389 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:44.485822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc379-296b-4a0a-bda8-179b44d1f6f8 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:44.494769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1359/2710] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:44.743818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:44.745486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:44.757829 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896afe-38d1-4d69-b25a-ea77bb02612a None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:44.764259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:44.764259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:44.764259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:44.764259 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] PATH_INFO: `/v3/projects/dca2dd2081f4473c8460c8399e49f9a3` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:44.765642 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca2dd2081f4473c8460c8399e49f9a3)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:44.767494 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:44.814982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca2dd2081f4473c8460c8399e49f9a3', 'request_id': 'req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.822613 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca2dd2081f4473c8460c8399e49f9a3', 'request_id': 'req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.829046 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca2dd2081f4473c8460c8399e49f9a3', 'request_id': 'req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.839869 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] The token cache is being invalidate because project dca2dd2081f4473c8460c8399e49f9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:20:44.840228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.840931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-ce7b903c-c4da-4be6-af4e-ae6dcb150be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:20:44.842845 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1352/2711] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:20:44 2022] DELETE /identity/v3/projects/dca2dd2081f4473c8460c8399e49f9a3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:20:44.847768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615605-111b-4148-9479-3dea89e65040 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:44.847876 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615605-111b-4148-9479-3dea89e65040 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:44.848185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615605-111b-4148-9479-3dea89e65040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:44.865555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a8615605-111b-4148-9479-3dea89e65040 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:44.866864 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a8615605-111b-4148-9479-3dea89e65040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:45.055819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1360/2712] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:45.063537 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.063822 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.064090 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.082466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:45.083637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:45.091427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1353/2713] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:20:45.095563 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615605-111b-4148-9479-3dea89e65040 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.104811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615605-111b-4148-9479-3dea89e65040 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.109361 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.109997 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.110272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.110540 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.111247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:20:45.111551 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.113121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.125896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1361/2714] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:20:45.130135 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.139849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0154a4-6e7e-4d36-bff9-81491ab20745 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.144346 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.144972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.145276 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.145545 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.146217 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.148114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.171560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1354/2715] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:20:45 2022] POST /identity/v3/projects => generated 363 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:20:45.175701 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.185918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec36ae-351d-466f-a38a-ef171d6c4dc0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.237304 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.237948 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.238227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.238499 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.239171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.241081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.261093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1362/2716] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:20:45 2022] POST /identity/v3/users => generated 282 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:20:45.265234 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.275178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec16ed-fb7b-4171-a6e2-22912e5e83b0 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.279682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.280321 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.280601 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.280873 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.281623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.283185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.293108 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1355/2717] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:45.296813 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.306867 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a95b6-6ef6-4f64-9881-d1ec15859465 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.311397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.312032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.312309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.312581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.313330 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.314902 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd3096-b054-4951-a0ef-01f4f4854f58 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.325662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1363/2718] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:20:45.329688 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.339552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371634b9-6a18-4db0-aae7-3b00c5b8b9c4 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.344336 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.345229 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.345501 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.345766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] PATH_INFO: `/v3/projects/f192af97be7f468db609d476e14b5e0b/users/462aa47bfb284fa5bfd590b8c46b2c3f/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.359466 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f192af97be7f468db609d476e14b5e0b, user_id=462aa47bfb284fa5bfd590b8c46b2c3f, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.362151 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.375734 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1356/2719] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:20:45 2022] PUT /identity/v3/projects/f192af97be7f468db609d476e14b5e0b/users/462aa47bfb284fa5bfd590b8c46b2c3f/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:20:45.387526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.387806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.388076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.413160 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] MFA Rules not processed for user `462aa47bfb284fa5bfd590b8c46b2c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:20:45.414994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:45.475328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1364/2720] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:20:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:20:45.485631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:45.487329 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:45.541386 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e097-e405-4153-8e3b-13f2c3a02848 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:45.544946 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:45.545633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:45.545915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:45.546184 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:45.554168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:45.556159 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:45.564563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1357/2721] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:49.481018 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:49.482598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:49.538218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6e5b2-ff3e-4480-86ed-55c3bc0b2ce5 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:49.542561 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:49.543219 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:49.543491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:49.543756 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:49.545633 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:49.618953 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:49.620391 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:49.632504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1365/2722] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:50.814640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:50.824592 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12de5a7-0d2d-42a1-93a9-6815714670c2 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:50.834906 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:50.835091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:50.835436 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:50.835645 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:50.838065 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:50.852034 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:50.854107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:50.865173 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1358/2723] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:20:52.341883 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:20:52.343271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:52.354069 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaec8d1-9a68-4e1a-908b-a3bfe93e0ef9 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:20:52.358541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:20:52.359191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:20:52.359468 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:20:52.359734 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:20:52.361526 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:20:52.439590 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:20:52.441086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:20:52.450594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1366/2724] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:20:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:05.488584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:05.498471 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019d73c-7252-4634-9443-083fb435ed32 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:05.502007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:05.502628 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:05.502904 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:05.503171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:05.504993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:05.582560 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:05.584020 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:05.604806 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1359/2725] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:13.035109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:13.044283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f0974-fb45-4254-ab6f-f29274a428f8 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:13.047949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:13.048573 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:13.048851 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:13.049161 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:13.050938 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:13.110635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:13.112051 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:13.122207 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1367/2726] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:16.084618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.086283 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:16.109381 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865001a-52e5-477d-9a40-89a034638668 service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.113967 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.114823 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.115125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.115401 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] PATH_INFO: `/v3/users/c737f50ef7264ed983209d16e28da75b` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.116570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c737f50ef7264ed983209d16e28da75b)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.118488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.166124 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c737f50ef7264ed983209d16e28da75b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.166771 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c737f50ef7264ed983209d16e28da75b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.174224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c737f50ef7264ed983209d16e28da75b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.174847 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c737f50ef7264ed983209d16e28da75b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.181504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8c32d0ce-781a-42e2-b288-ad88616cbe28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c737f50ef7264ed983209d16e28da75b'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.198326 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1360/2727] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:21:16 2022] DELETE /identity/v3/users/c737f50ef7264ed983209d16e28da75b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:21:16.368656 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.380247 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fdf52-700e-40c5-9bcc-64551879c131 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.435567 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.436488 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.436768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.437040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] PATH_INFO: `/v3/projects/55c503357f9d4544a24d58abe60a0d2b` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.438252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c503357f9d4544a24d58abe60a0d2b)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.440121 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.484827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c503357f9d4544a24d58abe60a0d2b', 'request_id': 'req-12a2e247-7279-4759-ab77-52b3deefac43'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.490023 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c503357f9d4544a24d58abe60a0d2b', 'request_id': 'req-12a2e247-7279-4759-ab77-52b3deefac43'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.497232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c503357f9d4544a24d58abe60a0d2b', 'request_id': 'req-12a2e247-7279-4759-ab77-52b3deefac43'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.507617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] The token cache is being invalidate because project 55c503357f9d4544a24d58abe60a0d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:21:16.507896 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.508492 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-12a2e247-7279-4759-ab77-52b3deefac43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:16.509981 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1368/2728] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:21:16 2022] DELETE /identity/v3/projects/55c503357f9d4544a24d58abe60a0d2b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:21:16.515043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.515313 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.515591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.533048 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:16.534255 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:16.590187 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1361/2729] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:16.597732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.598019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.598293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.616435 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:16.617658 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:16.625675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1369/2730] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:16.629664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.638983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c2290-4efb-4d1c-9648-71fcc5fd3c4b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.643623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.644264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.644543 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.644813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.645619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:21:16.645923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.647486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.659011 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1362/2731] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:21:16.663102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.672419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea0925-d0fd-44b4-aebc-b6676b41c2ff None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.676937 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.677617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.677892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.678158 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.678819 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.680650 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.704628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1370/2732] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:21:16 2022] POST /identity/v3/projects => generated 385 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:21:16.708758 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.718698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18838d7-9cd7-4577-8710-85eb0035e629 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.770863 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.771509 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.771786 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.772057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.772733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.774632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.794573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1363/2733] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:21:16 2022] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:21:16.798765 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.808662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e3ae7-8467-42e6-8bf1-530275a4af4e admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.813351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.813974 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.814252 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.814523 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.815239 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.816793 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.827180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1371/2734] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:21:16.830883 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.841426 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6e2ac-0d6a-4f1f-a031-8ab3f73c3795 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.846050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.846694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.846977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.847254 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.847982 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.849708 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13586da-b830-4be0-9309-b0fb5ba405e6 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.859383 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1364/2735] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:21:16.863276 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.872905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c32a-962d-42a4-996b-41fb7fe66dac admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:16.877407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:16.878246 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.878519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.878788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] PATH_INFO: `/v3/projects/afd516af18c645078471493a85458f3c/users/bc39b9125c274177a238ef24650cbb20/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.893048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd516af18c645078471493a85458f3c, user_id=bc39b9125c274177a238ef24650cbb20, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:16.895613 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:16.908476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1372/2736] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:21:16 2022] PUT /identity/v3/projects/afd516af18c645078471493a85458f3c/users/bc39b9125c274177a238ef24650cbb20/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:21:16.913507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c63b-8d8e-4db4-adb4-9564cb809179 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:16.913876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c63b-8d8e-4db4-adb4-9564cb809179 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:16.914242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c63b-8d8e-4db4-adb4-9564cb809179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:16.931521 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-7748c63b-8d8e-4db4-adb4-9564cb809179 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:16.932698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7748c63b-8d8e-4db4-adb4-9564cb809179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:16.987871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1365/2737] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:16.997560 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:16.999195 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:17.052932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da90f7-3468-43a9-a852-51befc0f9067 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:17.056575 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:17.057232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:17.057510 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:17.057824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:17.066693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:17.068129 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019cb97-151a-480b-8a54-c69dfe8a0dc8 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:17.077886 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1373/2738] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:17.676497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:17.677035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:17.677178 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:17.702746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] MFA Rules not processed for user `bc39b9125c274177a238ef24650cbb20`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:17.703960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:17.767635 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1366/2739] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:17.778786 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:17.779288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:17.779415 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:17.796426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] MFA Rules not processed for user `bc39b9125c274177a238ef24650cbb20`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:17.797646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:17.804755 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1374/2740] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:17.816033 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:17.817444 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:17.888795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214aaeb-b785-4936-97d2-56142d82d164 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:17.894199 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:17.894835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:17.895117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:17.895390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:17.903640 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:17.905224 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:17.913739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1367/2741] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:18.132522 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:18.142664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe673a-6932-4786-9023-4bdba0f2471c None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:18.146136 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:18.146762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:18.147042 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:18.147320 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:18.149032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:18.158199 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:18.159595 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:18.167269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1375/2742] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:18.483341 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:18.484762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:18.561319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a1cd8-1c8a-4d86-830c-85be64d70504 service nova] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:18.566382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:18.567047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:18.567322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:18.567596 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:18.569405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:18.581390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:18.582972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:18.593920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1368/2743] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:20.193178 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:20.201861 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae7ee-8002-47a3-82b5-c4d1e16ab4f1 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:20.205586 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:20.206255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:20.206538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:20.206811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:20.208533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:20.218225 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:20.219706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3e1e7-156a-4d8c-b499-76220c356081 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:20.227460 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1376/2744] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:32.873505 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:32.874871 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:32.887378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c37e7c-bc4a-47cf-a43f-3862c1f119fe service placement] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:32.891751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:32.892593 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:32.892868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:32.893171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] PATH_INFO: `/v3/users/462aa47bfb284fa5bfd590b8c46b2c3f` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:32.894320 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462aa47bfb284fa5bfd590b8c46b2c3f)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:32.896174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:32.939835 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462aa47bfb284fa5bfd590b8c46b2c3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:32.940490 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462aa47bfb284fa5bfd590b8c46b2c3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:32.947241 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462aa47bfb284fa5bfd590b8c46b2c3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:32.947880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462aa47bfb284fa5bfd590b8c46b2c3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:32.954473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462aa47bfb284fa5bfd590b8c46b2c3f'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:32.971365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1369/2745] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:21:32 2022] DELETE /identity/v3/users/462aa47bfb284fa5bfd590b8c46b2c3f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:21:32.975854 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:32.976350 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:32.976450 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:32.994175 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:32.995394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.052256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1377/2746] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:33.062123 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.063491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.118981 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6091e-0d42-4bed-ba93-d76a86e48af1 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.122818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.123461 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.123739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.124016 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.132919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.134337 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4af2e7-c232-44e7-a1cd-fde4e9695433 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.143382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1370/2747] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:33.397555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.399133 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.411863 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edee14-85dd-4fa7-8d55-38e3faa526c7 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.416485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.417976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.418255 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.418527 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] PATH_INFO: `/v3/projects/f192af97be7f468db609d476e14b5e0b` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.420015 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f192af97be7f468db609d476e14b5e0b)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.421795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.467931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f192af97be7f468db609d476e14b5e0b', 'request_id': 'req-978543c3-90f6-40a7-9e5b-79f6b137692e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:33.473157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f192af97be7f468db609d476e14b5e0b', 'request_id': 'req-978543c3-90f6-40a7-9e5b-79f6b137692e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:33.480822 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f192af97be7f468db609d476e14b5e0b', 'request_id': 'req-978543c3-90f6-40a7-9e5b-79f6b137692e'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:33.491455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] The token cache is being invalidate because project f192af97be7f468db609d476e14b5e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:21:33.491747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:33.492379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-978543c3-90f6-40a7-9e5b-79f6b137692e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:21:33.493917 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1378/2748] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:21:33 2022] DELETE /identity/v3/projects/f192af97be7f468db609d476e14b5e0b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:21:33.499745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.500055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.500356 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.517350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:33.518524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.574465 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1371/2749] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:33.582171 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.582459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.582740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.600394 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:33.601589 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.609695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1379/2750] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:33.613638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.623856 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c298f-c232-420c-a6f9-217f0daa96d4 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.628423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.629094 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.629368 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.629637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.630348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:21:33.630672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.632228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.644021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1372/2751] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:21:33.648082 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.657541 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868c3df-0a7d-4da2-b028-3fb017eedb50 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.662095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.662739 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.663014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.663283 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.663955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.665843 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.691227 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1380/2752] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:21:33 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:21:33.695225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.705456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75b711-114f-40a4-98bb-426537a43020 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.757899 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.758552 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.758831 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.759106 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.759785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.762440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.780920 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1373/2753] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:21:33 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:21:33.785113 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.795083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5955e64-0e2d-43fc-b01e-d9f8684c3f08 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.799744 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.800385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.800668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.800944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.801698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.803261 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.813782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1381/2754] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:21:33.817474 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.827464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c053bb-4174-49d5-89e1-95a5abe43f2f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.831894 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.832526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.832804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.833102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.833816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.835359 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80666a-843c-488c-a4c6-37264308be5e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.844738 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1374/2755] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:21:33.848442 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.858212 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660ef10-98a9-4c15-b1eb-3bb9e4432105 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:33.863185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:33.864385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.864695 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.865177 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] PATH_INFO: `/v3/projects/edc104455e2e4cadacddad46e85abfee/users/7fc5fc74652048e8a1facd50cd61dc11/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.880463 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc104455e2e4cadacddad46e85abfee, user_id=7fc5fc74652048e8a1facd50cd61dc11, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:33.883081 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:33.895921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1382/2756] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:21:33 2022] PUT /identity/v3/projects/edc104455e2e4cadacddad46e85abfee/users/7fc5fc74652048e8a1facd50cd61dc11/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:21:33.900914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec94f-d7ee-44a7-8001-4707abffbced None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:33.901432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec94f-d7ee-44a7-8001-4707abffbced None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:33.901548 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ec94f-d7ee-44a7-8001-4707abffbced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:33.918403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1e8ec94f-d7ee-44a7-8001-4707abffbced None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:33.919562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1e8ec94f-d7ee-44a7-8001-4707abffbced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:33.975391 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1375/2757] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:33.984856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:33.986655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:34.040030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eead08-8119-4a7e-b798-4db6100d24f0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:34.044170 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:34.044788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:34.045079 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:34.045364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:34.054466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:34.055619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:34.065422 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1383/2758] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:34.655780 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a0ad-52b4-49a7-b1d8-3af47ad8ac0e None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:34.656068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a0ad-52b4-49a7-b1d8-3af47ad8ac0e None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:34.656370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02a0ad-52b4-49a7-b1d8-3af47ad8ac0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:34.683005 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ad02a0ad-52b4-49a7-b1d8-3af47ad8ac0e None None] MFA Rules not processed for user `7fc5fc74652048e8a1facd50cd61dc11`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:34.684195 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ad02a0ad-52b4-49a7-b1d8-3af47ad8ac0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:34.748111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1376/2759] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:34.757379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:34.758924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:34.813728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05eaf91-2d32-418a-9f96-d64d61229f0f service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:34.817236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:34.817862 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:34.818137 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:34.818405 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:34.827932 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:34.829402 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a162f-e87f-4711-ad2e-472652fb0d81 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:34.837802 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1384/2760] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:21:36.156766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:36.157317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:36.157317 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:36.174868 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] MFA Rules not processed for user `7fc5fc74652048e8a1facd50cd61dc11`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:36.176088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:36.183252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1377/2761] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:38.362674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4866ac-35e2-4748-9e38-55974b836aa9 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:38.363256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4866ac-35e2-4748-9e38-55974b836aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:38.363367 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4866ac-35e2-4748-9e38-55974b836aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:38.381769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1c4866ac-35e2-4748-9e38-55974b836aa9 None None] MFA Rules not processed for user `bc39b9125c274177a238ef24650cbb20`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:38.383096 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1c4866ac-35e2-4748-9e38-55974b836aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:38.440659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1385/2762] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:21:39.207077 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:21:39.208541 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:39.287171 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be46d-a727-4731-97a0-c5b9ecb923a6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:21:39.292813 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:21:39.294120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:39.294399 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:39.294672 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:39.296423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:39.309194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:21:39.310950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37678a76-d743-406b-9e51-0abaadf20f4c service nova] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:21:39.322438 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1378/2763] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:21:51.682169 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:21:51.682726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:21:51.682839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:21:51.700884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] MFA Rules not processed for user `bc39b9125c274177a238ef24650cbb20`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:21:51.702130 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:21:51.712810 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1386/2764] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:21:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:22:22.016897 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70e4c-7b5f-41a0-b695-cb2670d9173b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:22:22.017483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70e4c-7b5f-41a0-b695-cb2670d9173b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:22:22.017483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf70e4c-7b5f-41a0-b695-cb2670d9173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:22:22.034623 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-eaf70e4c-7b5f-41a0-b695-cb2670d9173b None None] MFA Rules not processed for user `bc39b9125c274177a238ef24650cbb20`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:22:22.035812 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-eaf70e4c-7b5f-41a0-b695-cb2670d9173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:22:22.042639 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1379/2765] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:22:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:22:42.864675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:22:42.866110 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:22:42.883001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929101ed-6bca-48c9-aef6-ce186a37f9f8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:22:42.888578 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f538116ef3047e092d7680577ac75f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:22:42.889240 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:22:42.889648 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:22:42.889924 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:22:42.891652 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:22:42.903471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:22:42.905011 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:22:42.916026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1387/2766] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:22:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:03.115618 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:03.116225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:03.116225 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:03.135364 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] MFA Rules not processed for user `7fc5fc74652048e8a1facd50cd61dc11`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:03.136776 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:03.144303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1380/2767] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:03.370305 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:03.379466 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889b3e-1aa2-4a1c-932e-96e916e5029d service nova] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:03.383028 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:03.383640 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:03.383915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:03.384185 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:03.385930 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:03.394844 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:03.396812 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:03.404416 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1388/2768] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:22.539192 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:22.540695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:22.556087 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d2b0-dcd9-44ac-9a76-2bb22d4658dd None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:22.560659 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:22.561536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:22.561817 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:22.562116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] PATH_INFO: `/v3/users/bc39b9125c274177a238ef24650cbb20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:22.563282 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc39b9125c274177a238ef24650cbb20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:22.565228 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:22.609091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc39b9125c274177a238ef24650cbb20'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.609671 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc39b9125c274177a238ef24650cbb20'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.617071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc39b9125c274177a238ef24650cbb20'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.617687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc39b9125c274177a238ef24650cbb20'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.624502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-79c6eaa5-4ecd-4955-8f41-9ad458ee29c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc39b9125c274177a238ef24650cbb20'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.641314 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1381/2769] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:22 2022] DELETE /identity/v3/users/bc39b9125c274177a238ef24650cbb20 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:22.812277 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:22.823768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf6f8-6523-4dd8-98a2-033293e130ea service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:22.882654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:22.883529 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:22.883784 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:22.884056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] PATH_INFO: `/v3/projects/afd516af18c645078471493a85458f3c` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:22.885250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd516af18c645078471493a85458f3c)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:22.887122 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:22.937875 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd516af18c645078471493a85458f3c', 'request_id': 'req-18e63600-490e-47e5-8a8c-f1474d0ccf18'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.943871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd516af18c645078471493a85458f3c', 'request_id': 'req-18e63600-490e-47e5-8a8c-f1474d0ccf18'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.951465 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd516af18c645078471493a85458f3c', 'request_id': 'req-18e63600-490e-47e5-8a8c-f1474d0ccf18'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.962580 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] The token cache is being invalidate because project afd516af18c645078471493a85458f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:22.962926 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.963591 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-18e63600-490e-47e5-8a8c-f1474d0ccf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:22.965303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1389/2770] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:22 2022] DELETE /identity/v3/projects/afd516af18c645078471493a85458f3c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:22.969953 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313691-4174-4564-a8f6-07d6a432142b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:22.970251 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313691-4174-4564-a8f6-07d6a432142b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:22.970508 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55313691-4174-4564-a8f6-07d6a432142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:22.989373 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-55313691-4174-4564-a8f6-07d6a432142b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:22.991177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-55313691-4174-4564-a8f6-07d6a432142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:23.048038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1382/2771] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:23.056441 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.056721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.056996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.075628 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:23.076798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:23.084788 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1390/2772] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:23.088914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55313691-4174-4564-a8f6-07d6a432142b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.098432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55313691-4174-4564-a8f6-07d6a432142b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.103235 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.103919 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.104197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.104467 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.105212 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:23:23.105513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.107125 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.118795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1383/2773] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:23:23.123250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.132877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98034a-60e6-453c-85c3-25971ce7574d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.137693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.138333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.138608 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.138877 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.139558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.141517 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.165533 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1391/2774] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:23.169680 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.179889 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267669-4494-4c2d-a444-b36e08af152e admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.232732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.233434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.233720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.233992 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.234665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.236567 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.256267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1384/2775] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:23.260404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.270309 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc0b8-722f-4305-88f5-9a57c8d8a69c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.275065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.275710 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.276000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.276258 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.276972 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.278562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.289093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1392/2776] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:23.292839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.302267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b8ee-8fb2-4707-8a0f-646bbdfaa432 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.307463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.308102 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.308377 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.308648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.309390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.310943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ab0b1-3723-41c6-82d2-130318ecaabe admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.320362 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1385/2777] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:23:23.324291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.333874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc13a5c-6934-4fd4-be37-0e524de12eb2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.338407 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.339256 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.339531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.339801 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] PATH_INFO: `/v3/projects/af054eaffdd04948b3236c2f7bc3874d/users/1e01aa5d70254f8ab317b418f271b040/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.353940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af054eaffdd04948b3236c2f7bc3874d, user_id=1e01aa5d70254f8ab317b418f271b040, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.356509 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.369126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1393/2778] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:23 2022] PUT /identity/v3/projects/af054eaffdd04948b3236c2f7bc3874d/users/1e01aa5d70254f8ab317b418f271b040/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:23.379129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.379441 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.379722 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.404753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] MFA Rules not processed for user `1e01aa5d70254f8ab317b418f271b040`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:23.405896 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:23.466522 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1386/2779] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:23.471232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.528599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f73ef-8255-4260-932b-83bd5021fe23 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.533202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.533907 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.534184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.534455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.535120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.537475 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.561653 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1394/2780] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:23.565431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.576070 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead99848-12c9-458c-ae1d-ca40961c6337 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.628984 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.629664 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.629942 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.630214 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.630929 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.632794 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.652762 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1387/2781] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:23.656707 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.667485 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf9771-59f0-4f37-b33d-124114c7d9d2 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.672074 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.672735 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.673001 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.673315 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.674031 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.675671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.686165 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1395/2782] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:23:23.690067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.699710 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa288b6-ea98-4a2f-a2fe-ec7f36b2c624 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.704496 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.705410 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.705692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.705965 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] PATH_INFO: `/v3/projects/26236d494bc64fdbab439edfab9af02f/users/48998defea6e44a8af49b15878c116a1/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.720581 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26236d494bc64fdbab439edfab9af02f, user_id=48998defea6e44a8af49b15878c116a1, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.723306 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.736427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1388/2783] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:23 2022] PUT /identity/v3/projects/26236d494bc64fdbab439edfab9af02f/users/48998defea6e44a8af49b15878c116a1/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:23.740426 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.750404 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984220d-b8ca-4997-8e19-93f4427b9748 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.806944 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.807603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.807901 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.808162 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.808887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.810478 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177b800-ebe8-4c21-b9e7-fdbf87c829d2 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.820688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1396/2784] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:23.824840 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.834731 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1db584-c08d-4e8f-9e67-e3779d53c897 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:23.839413 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:23.840280 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.840561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.840830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] PATH_INFO: `/v3/projects/26236d494bc64fdbab439edfab9af02f/users/48998defea6e44a8af49b15878c116a1/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.842811 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26236d494bc64fdbab439edfab9af02f, user_id=48998defea6e44a8af49b15878c116a1, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:23.845403 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:23.856117 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1389/2785] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:23 2022] PUT /identity/v3/projects/26236d494bc64fdbab439edfab9af02f/users/48998defea6e44a8af49b15878c116a1/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:23.866732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:23.867053 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:23.867384 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:23.894594 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] MFA Rules not processed for user `48998defea6e44a8af49b15878c116a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:23.895798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:23.970182 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1397/2786] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:23.982682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:23.984423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:24.039113 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5331ff-da34-43a0-84ff-8337e49ff2a7 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:24.042759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:24.043389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:24.043670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:24.043945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:24.052661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:24.054088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:24.063136 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1390/2787] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:24.129871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:24.139873 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1633-5029-439d-9faf-98d761ae5cb8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:24.143472 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:24.144095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:24.144369 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:24.144638 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:24.199300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:24.200637 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdc9ab-d912-40f0-9469-910453d18668 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:24.209841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1398/2788] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:42.203072 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:42.302007 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee983f6-e92e-4dcf-b497-82b458a3a89a service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:42.307119 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:42.307966 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:42.308239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:42.308504 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] PATH_INFO: `/v3/users/1e01aa5d70254f8ab317b418f271b040` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:42.309778 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e01aa5d70254f8ab317b418f271b040)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:42.311756 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:42.358114 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e01aa5d70254f8ab317b418f271b040'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.358724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e01aa5d70254f8ab317b418f271b040'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.366035 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e01aa5d70254f8ab317b418f271b040'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.367630 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e01aa5d70254f8ab317b418f271b040'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.377478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e01aa5d70254f8ab317b418f271b040'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.397088 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1391/2789] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:42 2022] DELETE /identity/v3/users/1e01aa5d70254f8ab317b418f271b040 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:42.401609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:42.402105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:42.402243 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:42.450337 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:42.451532 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:42.507179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1399/2790] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:23:42.517396 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:42.518805 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:42.606782 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2531601-7e7a-4826-b66e-5adeab844d8f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:42.610464 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:42.611044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:42.611322 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:42.611590 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:42.621095 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:42.622759 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:42.631764 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1392/2791] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:42.897354 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:42.898983 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:42.914016 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ae84d-a6b4-40ef-a114-1e9dc40fab02 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:42.918821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:42.919759 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:42.920039 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:42.920308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] PATH_INFO: `/v3/projects/af054eaffdd04948b3236c2f7bc3874d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:42.921555 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af054eaffdd04948b3236c2f7bc3874d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:42.923535 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:42.971093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af054eaffdd04948b3236c2f7bc3874d', 'request_id': 'req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.977236 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af054eaffdd04948b3236c2f7bc3874d', 'request_id': 'req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.983821 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af054eaffdd04948b3236c2f7bc3874d', 'request_id': 'req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.995190 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] The token cache is being invalidate because project af054eaffdd04948b3236c2f7bc3874d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:42.995474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.996111 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:42.997899 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1400/2792] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:42 2022] DELETE /identity/v3/projects/af054eaffdd04948b3236c2f7bc3874d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:43.001983 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.011355 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36996c05-87f2-45a0-be22-e3597a383269 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.065763 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.066610 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.066888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.067157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] PATH_INFO: `/v3/users/48998defea6e44a8af49b15878c116a1` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.068301 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48998defea6e44a8af49b15878c116a1)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.070203 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.115074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48998defea6e44a8af49b15878c116a1'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.115752 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48998defea6e44a8af49b15878c116a1'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.122382 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48998defea6e44a8af49b15878c116a1'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.122977 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48998defea6e44a8af49b15878c116a1'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.129769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e7ff21bb-7bef-4e3c-9cd1-77721022573a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48998defea6e44a8af49b15878c116a1'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.147097 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1393/2793] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:43 2022] DELETE /identity/v3/users/48998defea6e44a8af49b15878c116a1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:43.421913 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.423451 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:43.436841 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03894c85-1cf9-43a2-ae6e-414d7ca3ca29 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.502221 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.503061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.503335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.503603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] PATH_INFO: `/v3/projects/26236d494bc64fdbab439edfab9af02f` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.504811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26236d494bc64fdbab439edfab9af02f)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.507598 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.555651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26236d494bc64fdbab439edfab9af02f', 'request_id': 'req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.560716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26236d494bc64fdbab439edfab9af02f', 'request_id': 'req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.567777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26236d494bc64fdbab439edfab9af02f', 'request_id': 'req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.578728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] The token cache is being invalidate because project 26236d494bc64fdbab439edfab9af02f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:43.579006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.579617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-2a8ea832-9380-47b0-9ea4-b8ccb07ab86c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:43.581153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1401/2794] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:43 2022] DELETE /identity/v3/projects/26236d494bc64fdbab439edfab9af02f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:43.586614 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.587116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.587231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.633882 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:43.635057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:43.690790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1394/2795] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:23:43.698945 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.699230 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.699505 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.717530 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:43.718680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:43.726301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1402/2796] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:43.730519 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.740157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99a688-9f1a-4e27-8cab-60f7b0308a4b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.744891 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.745556 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.745832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.746100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.746808 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:23:43.747369 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.748931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.760715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1395/2797] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:23:43.764717 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.773991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c54aa-2c66-47ff-a51b-50c278142fb0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.778558 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.779179 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.779455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.779722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.780400 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.782268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.808371 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1403/2798] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:43 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:43.811816 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.822132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02cd35-5ef5-4363-8e78-8967f49dfb14 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.879252 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.879921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.880206 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.880599 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.881324 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.883892 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.903637 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1396/2799] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:43 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:43.907767 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.920498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae23918-f5e6-404b-a9c8-8524336341cd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.925268 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.925988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.926339 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.926619 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.927335 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.929430 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.939773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1404/2800] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:43.943923 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.955677 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164860d-167c-473b-bc17-318eeaef7917 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.960931 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.961745 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.962032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.962303 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:43.963028 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:43.964888 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe277f-6343-4db0-9be7-9d363015c3d3 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:43.976876 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1397/2801] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:43.980076 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:43.990568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be85ce-665b-43a1-91ea-2a2d791b9636 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:43.996599 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:43.997763 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:43.998351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:43.998351 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] PATH_INFO: `/v3/projects/b7404d79d5f04add83c230e5cb2358c3/users/517fb5a3f3ce48c2914458ec91a64099/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.013839 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7404d79d5f04add83c230e5cb2358c3, user_id=517fb5a3f3ce48c2914458ec91a64099, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.016504 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.029557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1405/2802] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:43 2022] PUT /identity/v3/projects/b7404d79d5f04add83c230e5cb2358c3/users/517fb5a3f3ce48c2914458ec91a64099/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:44.039785 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.040258 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.040591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.067502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] MFA Rules not processed for user `517fb5a3f3ce48c2914458ec91a64099`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:44.068742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:44.130804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1398/2803] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:44.135308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.192319 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1e69f-6935-40c2-9393-987da1019823 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.197528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.198105 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.198379 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.198647 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.199323 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.201188 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.224990 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1406/2804] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:44 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:44.229429 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.239492 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b15cef-3c4c-4d51-8d74-b17ceee0248d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.293038 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.293723 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.294006 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.294340 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.295032 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.296994 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.316021 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1399/2805] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:44 2022] POST /identity/v3/users => generated 306 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:44.320482 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.330870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733890f-bdca-48eb-af80-ac587a527fbb admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.336338 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.336986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.337306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.337583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.338302 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.339870 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.353664 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1407/2806] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:44.354783 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.364397 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b32e6f-f55f-4823-abce-8280076bcdcd admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.369132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.370023 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.370300 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.370570 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] PATH_INFO: `/v3/projects/e7e32aa9481b457294d1e3d411bb8180/users/75338d51ce5a4839823a9178d36db7f9/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.386057 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e32aa9481b457294d1e3d411bb8180, user_id=75338d51ce5a4839823a9178d36db7f9, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.388665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.404263 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1400/2807] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:44 2022] PUT /identity/v3/projects/e7e32aa9481b457294d1e3d411bb8180/users/75338d51ce5a4839823a9178d36db7f9/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:44.408269 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.418131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336f3bb-39aa-4f4c-8fcf-57983e437fc1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.473596 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.474220 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.474493 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.474764 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.475516 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.477097 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cd5bc-ae79-40b4-9378-235f5840c0e3 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.486955 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1408/2808] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:23:44.491261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.501648 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ac056-1b4a-475b-98cb-c8f3aba9d24c admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.506266 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.509488 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.509801 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.510071 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] PATH_INFO: `/v3/projects/e7e32aa9481b457294d1e3d411bb8180/users/75338d51ce5a4839823a9178d36db7f9/roles/408af600f9f04514bc0631f4887e6d97` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.512055 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e32aa9481b457294d1e3d411bb8180, user_id=75338d51ce5a4839823a9178d36db7f9, role_id=408af600f9f04514bc0631f4887e6d97)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.514694 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.525489 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1401/2809] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:44 2022] PUT /identity/v3/projects/e7e32aa9481b457294d1e3d411bb8180/users/75338d51ce5a4839823a9178d36db7f9/roles/408af600f9f04514bc0631f4887e6d97 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:44.536423 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.536705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.536976 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.563014 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] MFA Rules not processed for user `75338d51ce5a4839823a9178d36db7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:44.564191 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:44.631672 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1409/2810] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:44.641772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.643513 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:44.698074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f615f43-6963-45fc-b1b7-7c5dbc9e4987 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.701777 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.702409 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.702691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.702969 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.711739 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.713168 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.722240 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1402/2811] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:44.795858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:44.806279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae79c5d-d591-4379-a265-d94139b55541 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:44.810029 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:44.810644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:44.810922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:44.811186 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:44.868539 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:44.870279 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07c086-7c8d-452d-be01-3ed86174c3e8 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:44.879157 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1410/2812] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:48.917514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:48.976357 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a70c5-a035-43bd-914d-6e357a0a350b service cinder] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:48.980900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:48.981862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:48.982201 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:48.982486 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] PATH_INFO: `/v3/users/517fb5a3f3ce48c2914458ec91a64099` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:48.983924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517fb5a3f3ce48c2914458ec91a64099)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:48.985619 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:49.039457 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517fb5a3f3ce48c2914458ec91a64099'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.040107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517fb5a3f3ce48c2914458ec91a64099'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.046879 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517fb5a3f3ce48c2914458ec91a64099'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.047502 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517fb5a3f3ce48c2914458ec91a64099'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.056450 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517fb5a3f3ce48c2914458ec91a64099'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.075411 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1403/2813] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:48 2022] DELETE /identity/v3/users/517fb5a3f3ce48c2914458ec91a64099 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:49.079891 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:49.080397 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:49.080498 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:49.110677 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:49.112071 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:49.177318 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1411/2814] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:49.187050 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:49.188514 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:49.248796 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7c1db-9d5c-4460-86ed-029895578013 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:49.252473 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:49.253174 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:49.253456 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:49.253729 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:49.263267 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:49.264751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:49.274914 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1404/2815] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:49.549748 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:49.551447 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:49.563357 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a21950-1ac6-4159-92c1-999749da8978 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:49.568476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:49.569911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:49.570198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:49.570651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] PATH_INFO: `/v3/projects/b7404d79d5f04add83c230e5cb2358c3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:49.572119 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7404d79d5f04add83c230e5cb2358c3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:49.574040 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:49.621217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7404d79d5f04add83c230e5cb2358c3', 'request_id': 'req-8f186081-9dc4-47d1-81bd-ac9b113b4294'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.626970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7404d79d5f04add83c230e5cb2358c3', 'request_id': 'req-8f186081-9dc4-47d1-81bd-ac9b113b4294'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.634780 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7404d79d5f04add83c230e5cb2358c3', 'request_id': 'req-8f186081-9dc4-47d1-81bd-ac9b113b4294'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.646815 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] The token cache is being invalidate because project b7404d79d5f04add83c230e5cb2358c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:49.647085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.647775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.649525 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1412/2816] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:49 2022] DELETE /identity/v3/projects/b7404d79d5f04add83c230e5cb2358c3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:49.653507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:49.662704 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a84d07-5101-4b7d-b668-3bed1803b3f8 service neutron] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:49.722534 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:49.723421 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:49.723687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:49.723961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] PATH_INFO: `/v3/users/75338d51ce5a4839823a9178d36db7f9` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:49.725191 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75338d51ce5a4839823a9178d36db7f9)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:49.727735 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:49.779517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75338d51ce5a4839823a9178d36db7f9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.780231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75338d51ce5a4839823a9178d36db7f9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.788047 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75338d51ce5a4839823a9178d36db7f9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.789557 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75338d51ce5a4839823a9178d36db7f9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.796634 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-8f12d2e7-814e-4262-932c-76f0de354e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75338d51ce5a4839823a9178d36db7f9'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:49.813940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1405/2817] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:49 2022] DELETE /identity/v3/users/75338d51ce5a4839823a9178d36db7f9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:50.087148 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.088659 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:50.104693 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186081-9dc4-47d1-81bd-ac9b113b4294 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.163874 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.164642 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.164919 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.165217 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] PATH_INFO: `/v3/projects/e7e32aa9481b457294d1e3d411bb8180` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.166387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e32aa9481b457294d1e3d411bb8180)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.168272 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.215949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e32aa9481b457294d1e3d411bb8180', 'request_id': 'req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.221424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e32aa9481b457294d1e3d411bb8180', 'request_id': 'req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.233782 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e32aa9481b457294d1e3d411bb8180', 'request_id': 'req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.246385 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] The token cache is being invalidate because project e7e32aa9481b457294d1e3d411bb8180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:50.246674 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.247568 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3b18ff9b-4dfa-43bf-afba-15adb65dacc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.249092 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1413/2818] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:50 2022] DELETE /identity/v3/projects/e7e32aa9481b457294d1e3d411bb8180 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:50.253959 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.254433 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.254532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.271638 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:50.272836 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:50.328420 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1406/2819] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:50.336143 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.336434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.336716 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.355012 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:50.356224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:50.364224 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1414/2820] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:50.368824 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.378417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598d29e-59fb-4e1e-a073-b27050b0e431 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.383031 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.383676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.383960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.384227 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.384940 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:23:50.385274 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.386918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.398407 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1407/2821] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:23:50.402301 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.411612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c87a0-2376-4fa2-adca-23fc5f8e56d0 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.416803 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.417474 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.417757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.418032 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.418722 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.420581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.450308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1415/2822] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:50 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:23:50.451432 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.461372 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e6243-17e5-4d9f-8f33-f5c71745cb55 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.520390 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.521089 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.521370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.521755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.522696 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.524458 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.546825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1408/2823] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:50 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:23:50.551726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.561728 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15544e-f785-46ff-93a6-fcf475a324dd admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.567030 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.567682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.567965 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.568248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.568984 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.570612 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.580858 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1416/2824] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:23:50.584834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.595194 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454653b9-e85c-4887-ba14-ec7f1868c9ee admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.599853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.600524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.601485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.601791 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.602662 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.604239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5c41a-0e56-46e8-967b-984a1de411ce admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.614532 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1409/2825] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:50.618508 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.628459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de75bf3-65e1-49d6-a9cc-c4858ba625b1 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.633500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.634360 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.634636 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.634903 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] PATH_INFO: `/v3/projects/ca60245a87564177a6604740c33ae099/users/261a37f018184f66a0119c6346edf28d/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.649769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca60245a87564177a6604740c33ae099, user_id=261a37f018184f66a0119c6346edf28d, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.652355 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.665325 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1417/2826] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:50 2022] PUT /identity/v3/projects/ca60245a87564177a6604740c33ae099/users/261a37f018184f66a0119c6346edf28d/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:50.675561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.675846 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.676116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.701250 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] MFA Rules not processed for user `261a37f018184f66a0119c6346edf28d`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:50.702549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:50.763751 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1410/2827] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:23:50.774126 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.775726 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:50.829213 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b14f9-58ae-4474-af1e-f7073f027ed0 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.832833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.833491 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.833769 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.834041 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.842528 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.843934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f47e1-3dfe-4fab-9ae4-bdc63c2bc725 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.852925 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1418/2828] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:50.872170 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:50.930565 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f461b7a-643f-4f88-8432-0f0f388d3c2d None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:50.935064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:50.935912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:50.936185 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:50.936454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] PATH_INFO: `/v3/users/261a37f018184f66a0119c6346edf28d` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:50.937670 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] RBAC: Authorizing `identity:delete_user(user_id=261a37f018184f66a0119c6346edf28d)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:50.939582 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:50.983482 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261a37f018184f66a0119c6346edf28d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.984175 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261a37f018184f66a0119c6346edf28d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.991069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261a37f018184f66a0119c6346edf28d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.991839 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261a37f018184f66a0119c6346edf28d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:50.998799 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261a37f018184f66a0119c6346edf28d'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.015775 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1411/2829] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:50 2022] DELETE /identity/v3/users/261a37f018184f66a0119c6346edf28d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:51.020218 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.020503 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.020778 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.040047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:51.041262 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:51.098789 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1419/2830] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:51.108901 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.110363 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:51.167804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2be6-3299-4a07-87d8-87b18496368d admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.172177 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.172832 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.173155 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.173425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.183208 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.184625 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3728a3-8080-42ca-955f-f0b14fdd85d8 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.193915 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1412/2831] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:51.456231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.457697 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:51.469663 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dada57-4fc8-4ff5-8352-7b07e4a4151d None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.474469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.475316 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.475611 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.475884 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] PATH_INFO: `/v3/projects/ca60245a87564177a6604740c33ae099` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.477202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca60245a87564177a6604740c33ae099)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.479083 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.525464 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca60245a87564177a6604740c33ae099', 'request_id': 'req-da19d117-bda0-4858-95c3-3fd1b09e2080'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.530538 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca60245a87564177a6604740c33ae099', 'request_id': 'req-da19d117-bda0-4858-95c3-3fd1b09e2080'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.537313 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca60245a87564177a6604740c33ae099', 'request_id': 'req-da19d117-bda0-4858-95c3-3fd1b09e2080'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.547921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] The token cache is being invalidate because project ca60245a87564177a6604740c33ae099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:51.548204 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.548827 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-da19d117-bda0-4858-95c3-3fd1b09e2080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:51.550326 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1420/2832] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:51 2022] DELETE /identity/v3/projects/ca60245a87564177a6604740c33ae099 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:51.555893 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.556388 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.556612 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.574792 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:51.575972 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:51.632431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1413/2833] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:51.641184 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.641469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.641741 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.659671 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:51.660826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:51.669095 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1421/2834] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:51.673041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.682378 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ccf6-16ff-4143-b810-ed06142fc4d6 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.687041 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.687682 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.687962 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.688233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.688941 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:23:51.689285 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.690852 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.702627 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1414/2835] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:23:51.706621 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.716244 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475dbfcf-ac63-4e97-b1dd-c31c56afcdcc None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.720871 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.721556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.721833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.722102 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.722773 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.724617 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.749037 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1422/2836] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:23:51.753001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.763239 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2f8b0-e36a-48da-bf68-1e6d08c82e72 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.815993 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.816584 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.816862 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.817164 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.817848 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.820585 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.839687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1415/2837] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:51.843887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.853762 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac6883-ec9e-4cd2-a383-6030f128ae4a admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.858298 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.858935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.859216 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.859487 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.860198 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.861912 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.871766 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1423/2838] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:51.875766 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.886017 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b732-9bea-4981-971f-fc360312281a admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.890562 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.891197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.891476 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.891746 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.892452 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.894064 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fe0e7-7aac-4baf-a6fe-f5abec295d7d admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.904100 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1416/2839] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:51.907922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:51.917966 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c238e-c05b-4586-bb9f-e86caa7c6e64 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:51.922614 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:51.923495 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.923775 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.924048 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] PATH_INFO: `/v3/projects/17af98f8248c49bb902ceef567947874/users/77970069ad884b308d91db13b4242200/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.937825 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=17af98f8248c49bb902ceef567947874, user_id=77970069ad884b308d91db13b4242200, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:51.940390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:51.953153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1424/2840] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:51 2022] PUT /identity/v3/projects/17af98f8248c49bb902ceef567947874/users/77970069ad884b308d91db13b4242200/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:51.963857 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:51.964147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:51.964427 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:51.991128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] MFA Rules not processed for user `77970069ad884b308d91db13b4242200`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:51.992338 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.052478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1417/2841] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:52.062991 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:52.064668 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.119085 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643a63e-152a-4e14-ad82-4e6a83faf4ef admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:52.122973 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:52.123603 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.123878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.124147 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.133270 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:52.135564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:52.144688 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1425/2842] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:52.163632 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:52.223491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc08b-e552-4cce-9fcf-8be6bcd81eba None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:52.228294 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:52.229190 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.229472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.229747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] PATH_INFO: `/v3/users/77970069ad884b308d91db13b4242200` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.230936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77970069ad884b308d91db13b4242200)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:52.232834 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:52.286142 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77970069ad884b308d91db13b4242200'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.286825 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77970069ad884b308d91db13b4242200'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.296544 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77970069ad884b308d91db13b4242200'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.297629 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77970069ad884b308d91db13b4242200'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.305658 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-b311bb6f-fd3d-4f3a-98a2-0454e95b523f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77970069ad884b308d91db13b4242200'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.314120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:52.315673 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.323925 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1418/2843] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:52 2022] DELETE /identity/v3/users/77970069ad884b308d91db13b4242200 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:52.328049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.328358 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.328633 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.345197 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:52.346310 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.373457 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd4637-ae04-4e34-ab6f-4c31a4bdc411 service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:52.402853 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1419/2844] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:23:52.412181 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:52.413526 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.419519 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:52.420153 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.420431 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.420705 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.422470 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.435093 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:52.436635 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:52.447000 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1426/2845] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:23:52.469231 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751005-e45e-4d74-ad71-a9e23d454358 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:52.472769 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:52.473440 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.473720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.473989 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.483284 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:52.484676 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb8d27-e187-41bc-b606-d7d7bd9768e9 service neutron] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:52.494697 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1420/2846] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 21 10:23:52.913768 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:52.915655 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:52.927702 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2cc1-9b8d-4a24-aed3-a4608d053fa8 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:52.933084 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:52.933982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:52.934259 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:52.934531 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] PATH_INFO: `/v3/projects/17af98f8248c49bb902ceef567947874` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:52.935790 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17af98f8248c49bb902ceef567947874)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:52.937811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:52.984518 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17af98f8248c49bb902ceef567947874', 'request_id': 'req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.989675 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17af98f8248c49bb902ceef567947874', 'request_id': 'req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:52.999833 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17af98f8248c49bb902ceef567947874', 'request_id': 'req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:53.012300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] The token cache is being invalidate because project 17af98f8248c49bb902ceef567947874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79433) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:53.012584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:53.013250 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-3468c1c1-c699-4df6-ac4c-d7b7f0b57e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:53.014795 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1427/2847] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:52 2022] DELETE /identity/v3/projects/17af98f8248c49bb902ceef567947874 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:53.019749 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.020242 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.020345 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.037747 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:53.038943 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:53.098653 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1421/2848] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:23:53.106985 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.107200 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.107471 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.128542 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:53.130196 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:53.138872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1428/2849] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:53.143107 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.153669 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeba4c-6861-4b26-af31-086297a44971 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.159538 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.160233 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.160705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.160939 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] PATH_INFO: `/v3/domains` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.161687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:23:53.162091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.164339 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.175691 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1422/2850] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 21 10:23:53.180564 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.189556 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36735da-a373-4fc1-8323-7bdb81ff8140 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.194208 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.195342 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.195616 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.195887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] PATH_INFO: `/v3/projects` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.196559 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.198438 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.223490 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1429/2851] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:23:53 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:53.228483 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.238417 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd25fc3-8bec-4917-8efb-b9d0a8d9e805 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.292810 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.293566 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.293850 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.294128 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] PATH_INFO: `/v3/users` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.294833 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.296712 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.316793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1423/2852] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:23:53 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:23:53.321026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.330855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1e1c-9a87-4e04-8850-b74168ac448c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.335597 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.336411 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.336691 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.336962 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.337730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.339288 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.350002 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1430/2853] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 21 10:23:53.354507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.364365 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeb49c-c62d-4d38-beaf-d0c352c9f886 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.369715 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.370419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.370705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.371279 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.372261 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.373921 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ddca9-4b72-460f-8a41-c1e03cb8dbe4 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.383713 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1424/2854] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:23:53.387732 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.397248 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b8c93-de92-49d7-9336-115f5a071031 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.401887 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.402749 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] REQUEST_METHOD: `PUT` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.403047 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.403459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] PATH_INFO: `/v3/projects/767886ecaa96422d99bb4bfc838d7b2f/users/6dfff45e69f74f939478676f94fdb0ca/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.419609 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=767886ecaa96422d99bb4bfc838d7b2f, user_id=6dfff45e69f74f939478676f94fdb0ca, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.422232 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.436483 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1431/2855] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:23:53 2022] PUT /identity/v3/projects/767886ecaa96422d99bb4bfc838d7b2f/users/6dfff45e69f74f939478676f94fdb0ca/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:53.441849 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6137-35a9-49da-9f7f-556862338798 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.442150 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6137-35a9-49da-9f7f-556862338798 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.442425 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e6137-35a9-49da-9f7f-556862338798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.461434 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-a32e6137-35a9-49da-9f7f-556862338798 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:53.462626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a32e6137-35a9-49da-9f7f-556862338798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:53.523517 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1425/2856] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:53.535906 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:53.538676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:53.597271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d2ce8-b5ef-40f2-b7f6-c20592aa796c admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:53.601651 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:53.602303 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:53.602583 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:53.602855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:53.612940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:53.614480 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:53.625383 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1432/2857] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:54.519945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18384c65-38bc-4d6c-b88d-94345e38a89f None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:54.520844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18384c65-38bc-4d6c-b88d-94345e38a89f None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:54.521147 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18384c65-38bc-4d6c-b88d-94345e38a89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:54.549328 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-18384c65-38bc-4d6c-b88d-94345e38a89f None None] MFA Rules not processed for user `6dfff45e69f74f939478676f94fdb0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:54.550866 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-18384c65-38bc-4d6c-b88d-94345e38a89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:54.633733 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1426/2858] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:54.643630 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:54.645306 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:54.726459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110561e4-f176-4a32-b4f0-89bdbef89802 service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:54.732970 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:54.734061 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:54.734537 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:54.735022 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:54.745729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:54.748295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:54.773940 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1433/2859] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:23:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:23:56.191535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:56.191995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:56.192080 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:56.217718 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] MFA Rules not processed for user `6dfff45e69f74f939478676f94fdb0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:23:56.224750 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:56.226803 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1427/2860] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:23:59.552070 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:59.554108 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:23:59.567291 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0c4bb-5a9c-4aa9-bae9-3fc0e126a8fd service cinder] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:59.571872 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:59.572719 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:59.572992 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:59.573308 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] PATH_INFO: `/v3/users/f5ed59d6ca96458ca507a398d0a36bb3` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:59.574484 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ed59d6ca96458ca507a398d0a36bb3)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:59.576328 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:59.622986 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ed59d6ca96458ca507a398d0a36bb3'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.623634 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ed59d6ca96458ca507a398d0a36bb3'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.635476 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ed59d6ca96458ca507a398d0a36bb3'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.642581 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ed59d6ca96458ca507a398d0a36bb3'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.643372 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ed59d6ca96458ca507a398d0a36bb3'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.656271 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1434/2861] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:59 2022] DELETE /identity/v3/users/f5ed59d6ca96458ca507a398d0a36bb3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 21 10:23:59.845182 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:59.858524 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bfc01-b6dd-4d97-a9db-3a5e95568b47 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:23:59.915936 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:23:59.916793 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:23:59.917105 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:23:59.917384 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] PATH_INFO: `/v3/projects/b0c470aef15d45a0bed2b2d51870ab7c` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:23:59.918591 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c470aef15d45a0bed2b2d51870ab7c)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:23:59.920478 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:23:59.964039 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c470aef15d45a0bed2b2d51870ab7c', 'request_id': 'req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.972347 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c470aef15d45a0bed2b2d51870ab7c', 'request_id': 'req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.982010 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c470aef15d45a0bed2b2d51870ab7c', 'request_id': 'req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.988631 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] The token cache is being invalidate because project b0c470aef15d45a0bed2b2d51870ab7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:23:59.988912 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.989563 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:23:59.991044 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1428/2862] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:23:59 2022] DELETE /identity/v3/projects/b0c470aef15d45a0bed2b2d51870ab7c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:23:59.995019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:23:59.996374 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:00.009921 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759b56a-ed6a-4dcc-90f6-b536e5e5df10 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:00.063565 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:00.064408 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:00.064682 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:00.064949 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] PATH_INFO: `/v3/users/7ae59e0f102e43c68648a16f8289bc4d` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:00.066124 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae59e0f102e43c68648a16f8289bc4d)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:00.067996 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:00.116006 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae59e0f102e43c68648a16f8289bc4d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.116729 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae59e0f102e43c68648a16f8289bc4d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.128680 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae59e0f102e43c68648a16f8289bc4d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.137156 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae59e0f102e43c68648a16f8289bc4d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.137798 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae59e0f102e43c68648a16f8289bc4d'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.150687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1435/2863] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:23:59 2022] DELETE /identity/v3/users/7ae59e0f102e43c68648a16f8289bc4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:00.319666 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:00.321200 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:00.336152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7cf38-978a-408c-ba26-ad1b9a20d9d8 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:00.391884 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:00.392772 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:00.393074 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:00.393348 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] PATH_INFO: `/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:00.394512 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0198dd2e14f3465ebd1ddcd1ff587b25)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:00.396389 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:00.440463 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0198dd2e14f3465ebd1ddcd1ff587b25', 'request_id': 'req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.447272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0198dd2e14f3465ebd1ddcd1ff587b25', 'request_id': 'req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.453165 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0198dd2e14f3465ebd1ddcd1ff587b25', 'request_id': 'req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.463507 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] The token cache is being invalidate because project 0198dd2e14f3465ebd1ddcd1ff587b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:24:00.463795 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.464419 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:00.465950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1429/2864] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:24:00 2022] DELETE /identity/v3/projects/0198dd2e14f3465ebd1ddcd1ff587b25 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:14.148296 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:14.149753 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:14.162297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927982e7-8cf5-40da-b74e-2f55d3847f64 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:14.216146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:14.216988 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:14.217297 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:14.217569 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] PATH_INFO: `/v3/users/7fc5fc74652048e8a1facd50cd61dc11` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:14.218757 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc5fc74652048e8a1facd50cd61dc11)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:14.220676 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:14.263824 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc5fc74652048e8a1facd50cd61dc11'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.264459 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc5fc74652048e8a1facd50cd61dc11'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.275333 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc5fc74652048e8a1facd50cd61dc11'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.282392 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc5fc74652048e8a1facd50cd61dc11'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.283131 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-e3d741eb-d66b-48a1-8dd9-8574ad16fd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc5fc74652048e8a1facd50cd61dc11'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.295056 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1436/2865] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:24:14 2022] DELETE /identity/v3/users/7fc5fc74652048e8a1facd50cd61dc11 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:14.460880 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:14.462366 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:14.477485 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebc0b1-fe60-4e2a-be34-0fcb57aa4c38 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:14.531875 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:14.532724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:14.533000 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:14.533370 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] PATH_INFO: `/v3/projects/edc104455e2e4cadacddad46e85abfee` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:14.534549 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc104455e2e4cadacddad46e85abfee)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:14.536423 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:14.579594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc104455e2e4cadacddad46e85abfee', 'request_id': 'req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.586132 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc104455e2e4cadacddad46e85abfee', 'request_id': 'req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.592732 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc104455e2e4cadacddad46e85abfee', 'request_id': 'req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.602472 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] The token cache is being invalidate because project edc104455e2e4cadacddad46e85abfee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:24:14.602755 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.603385 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:14.604887 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1430/2866] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:24:14 2022] DELETE /identity/v3/projects/edc104455e2e4cadacddad46e85abfee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:16.149840 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e1d-00c2-4005-96b2-b94694aec5b8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:16.150424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e1d-00c2-4005-96b2-b94694aec5b8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:16.150424 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e1d-00c2-4005-96b2-b94694aec5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:16.168933 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-74d86e1d-00c2-4005-96b2-b94694aec5b8 None None] MFA Rules not processed for user `6dfff45e69f74f939478676f94fdb0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:16.170135 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-74d86e1d-00c2-4005-96b2-b94694aec5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:16.220934 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1437/2867] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:24:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:24:17.140742 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:17.142527 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:17.228001 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b61ae-2df1-4f26-9903-0dac61e1ea82 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:17.232986 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:17.233646 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:17.233924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:17.234196 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:17.235934 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:17.246830 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:17.248609 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:17.258049 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1431/2868] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:24:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:24:35.513720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454542-b85a-45c1-9500-a485e2aa76fa None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:35.514194 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454542-b85a-45c1-9500-a485e2aa76fa None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:35.514293 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f454542-b85a-45c1-9500-a485e2aa76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:35.570915 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-1f454542-b85a-45c1-9500-a485e2aa76fa None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:35.572098 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-1f454542-b85a-45c1-9500-a485e2aa76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:35.643900 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1438/2869] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Feb 21 10:24:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:24:35.689416 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:35.690779 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:35.767120 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7a766-d360-405d-b734-2123a8317634 service placement] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:35.772091 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:35.772720 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:35.773026 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:35.773330 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:35.781405 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:35.782950 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:35.790698 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1432/2870] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:24:50.405500 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:50.405982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:50.406086 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:50.423683 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] MFA Rules not processed for user `ed9393f0271a41a989524759a68dfc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:50.424878 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:50.431829 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1439/2871] 10.222.0.73 () {58 vars in 967 bytes} [Mon Feb 21 10:24:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:24:50.445665 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:50.455802 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af50af-28fb-476d-8d49-89065b17aee1 service swift] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:50.460692 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a55309bdafe4b12bd50bc6e944bb10c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:50.461371 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:50.461651 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:50.461924 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:50.470069 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:50.471598 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:50.479944 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1433/2872] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Feb 21 10:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 21 10:24:52.334856 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:52.336646 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:52.412918 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec273a9-474d-4fd5-b796-b5b2b800514e None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:52.415579 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:52.417557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.417557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.417557 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] PATH_INFO: `/v3/users/6dfff45e69f74f939478676f94fdb0ca` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.418964 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfff45e69f74f939478676f94fdb0ca)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:52.420494 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:52.465202 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfff45e69f74f939478676f94fdb0ca'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.465835 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfff45e69f74f939478676f94fdb0ca'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.476922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfff45e69f74f939478676f94fdb0ca'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.484455 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfff45e69f74f939478676f94fdb0ca'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.485211 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-99aeae85-5fb7-4d65-a26b-a2637bb5e2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfff45e69f74f939478676f94fdb0ca'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.497720 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1440/2873] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:24:52 2022] DELETE /identity/v3/users/6dfff45e69f74f939478676f94fdb0ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:52.664319 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:52.675104 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0faf0-bc92-4835-abb1-d71bae174c27 service swift] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:52.730146 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:52.730987 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.731265 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.731535 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] PATH_INFO: `/v3/projects/767886ecaa96422d99bb4bfc838d7b2f` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.732686 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=767886ecaa96422d99bb4bfc838d7b2f)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:52.734573 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:52.776844 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767886ecaa96422d99bb4bfc838d7b2f', 'request_id': 'req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.783226 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767886ecaa96422d99bb4bfc838d7b2f', 'request_id': 'req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.789037 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767886ecaa96422d99bb4bfc838d7b2f', 'request_id': 'req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.799148 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] The token cache is being invalidate because project 767886ecaa96422d99bb4bfc838d7b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:24:52.799431 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.800040 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-cc0e86e9-7ad0-4080-bd04-de47b59c84dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:24:52.801536 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1434/2874] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:24:52 2022] DELETE /identity/v3/projects/767886ecaa96422d99bb4bfc838d7b2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:52.806365 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.806644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.806922 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.824935 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:52.826139 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:52.881026 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1441/2875] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:24:52.889161 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.889454 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.889736 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.908938 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:52.910152 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:52.917900 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1435/2876] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:24:52.922055 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:52.931585 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c897c6f-f72c-416d-aa3d-6a5cf44841e3 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:52.936740 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:52.937403 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.937687 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.937967 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.938706 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79433) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 21 10:24:52.939065 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:52.940644 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:52.952419 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1442/2877] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Feb 21 10:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 21 10:24:52.956577 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:52.965453 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2337bc-86c1-4637-ad08-7a6f1c83725b None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:52.970068 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:52.970695 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:52.970968 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:52.971236 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:52.971903 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:52.973790 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:52.998111 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1436/2878] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Feb 21 10:24:52 2022] POST /identity/v3/projects => generated 399 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 21 10:24:53.002089 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:53.012300 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690e55-e70a-4c9a-a86c-218a0d720d82 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:53.067994 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:53.068649 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.068931 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.069895 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] PATH_INFO: `/v3/users` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.070624 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:53.072615 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:53.091698 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1443/2879] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Feb 21 10:24:53 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 21 10:24:53.095719 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:53.106264 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898429b-a8a5-4dc7-8de2-96a83be2da99 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:53.110804 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:53.111447 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.111724 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.111995 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.112705 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:53.114323 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:53.125211 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1437/2880] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:24:53.129257 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:53.139180 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f29f32-0a28-4685-9b28-b1985104cd07 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:53.143721 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:53.144364 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.144641 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.144911 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] PATH_INFO: `/v3/roles` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.145654 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:53.147273 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2249241-fb27-4faa-a374-1d6ba2713eef admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:53.156905 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1444/2881] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Feb 21 10:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 21 10:24:53.160753 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:53.171083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8b5a-cf0d-4684-b6fb-0f4724039f13 admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:53.175818 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:53.176678 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.176961 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.177272 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] PATH_INFO: `/v3/projects/32a9d211beb3471ca49bee7c84099476/users/0005c64b137b41b6947c6a9067857d49/roles/ae4ae0d888b948acbe5f5a7a262b2e20` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.192406 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a9d211beb3471ca49bee7c84099476, user_id=0005c64b137b41b6947c6a9067857d49, role_id=ae4ae0d888b948acbe5f5a7a262b2e20)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:53.195183 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:53.208043 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1438/2882] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Feb 21 10:24:53 2022] PUT /identity/v3/projects/32a9d211beb3471ca49bee7c84099476/users/0005c64b137b41b6947c6a9067857d49/roles/ae4ae0d888b948acbe5f5a7a262b2e20 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:24:53.218109 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] REQUEST_METHOD: `POST` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.218395 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.218669 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.246952 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.auth.core [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] MFA Rules not processed for user `0005c64b137b41b6947c6a9067857d49`. Rule list: `[]` (Enabled: `True`). {{(pid=79433) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:24:53.248390 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:53.308694 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1445/2883] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:24:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 21 10:24:53.318561 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:24:53.320215 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:24:53.393717 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c6cf-780a-4390-9bc0-9739dc8f7f2f admin admin] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:24:53.397316 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b9e74f74e4b4898bb81851831be5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:24:53.397945 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] REQUEST_METHOD: `GET` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:24:53.398223 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:24:53.398497 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:24:53.406493 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:24:53.407870 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba9c4e-9839-4709-ac5d-d896f5aaad0c service cinder] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:24:53.416349 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1439/2884] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:24:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:25:01.375562 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:25:01.436777 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a07b8f-ae49-42e6-a7b7-2d88469fc1e8 None None] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:25:01.441584 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:25:01.442434 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:25:01.442711 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:25:01.442982 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] PATH_INFO: `/v3/users/0005c64b137b41b6947c6a9067857d49` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:25:01.444146 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0005c64b137b41b6947c6a9067857d49)` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:25:01.446090 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:25:01.491231 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0005c64b137b41b6947c6a9067857d49'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:01.491855 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0005c64b137b41b6947c6a9067857d49'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:01.503627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0005c64b137b41b6947c6a9067857d49'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:01.510662 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0005c64b137b41b6947c6a9067857d49'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:01.511314 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.notifications [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0005c64b137b41b6947c6a9067857d49'} {{(pid=79433) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:01.523120 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1446/2885] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Feb 21 10:25:01 2022] DELETE /identity/v3/users/0005c64b137b41b6947c6a9067857d49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:25:01.527661 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] REQUEST_METHOD: `POST` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:25:01.528129 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:25:01.529270 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:25:01.546140 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.auth.core [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] MFA Rules not processed for user `27658e4102424ffd80d8ec01579038ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 21 10:25:01.547325 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:25:01.602101 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1440/2886] 10.222.0.73 () {58 vars in 957 bytes} [Mon Feb 21 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 21 10:25:01.612421 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:25:01.613747 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:25:01.668627 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f9a0-a986-45f0-9a87-2f50b6dc87d8 admin admin] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:25:01.672811 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ce1c786c9fd4009aba04bccafdd01e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:25:01.673469 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:25:01.673746 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:25:01.674019 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:25:01.682806 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:25:01.684295 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:25:01.694387 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1447/2887] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 21 10:25:01.952626 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] Authenticating user token {{(pid=79432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:25:01.954083 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.fernet_utils [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:25:01.967116 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc909a2-c0c4-4511-8006-d0c217309ff2 None None] Validating token access rules against request {{(pid=79432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:25:01.972491 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27658e4102424ffd80d8ec01579038ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eb1e05c525c48b0a68ad872b0aea42a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:25:01.973375 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:25:01.973650 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:25:01.973918 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] PATH_INFO: `/v3/projects/32a9d211beb3471ca49bee7c84099476` {{(pid=79432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:25:01.975768 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a9d211beb3471ca49bee7c84099476)` {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:25:01.977687 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] RBAC: Authorization granted {{(pid=79432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:25:02.024157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a9d211beb3471ca49bee7c84099476', 'request_id': 'req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:02.031067 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a9d211beb3471ca49bee7c84099476', 'request_id': 'req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:02.037350 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a9d211beb3471ca49bee7c84099476', 'request_id': 'req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e'} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:02.047679 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] The token cache is being invalidate because project 32a9d211beb3471ca49bee7c84099476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 21 10:25:02.047960 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:02.048594 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: DEBUG keystone.notifications [None req-e99d21f8-8180-4cf3-8a26-fb8893f2de0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 21 10:25:02.050157 dv-cinder-830091-1-iscsi devstack@keystone.service[79432]: [pid: 79432|app: 0|req: 1441/2888] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Feb 21 10:25:01 2022] DELETE /identity/v3/projects/32a9d211beb3471ca49bee7c84099476 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 21 10:30:03.262045 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] Authenticating user token {{(pid=79433) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 21 10:30:03.263443 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:30:03.329826 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833afc-809e-4602-b4b1-194621b53fdb service neutron] Validating token access rules against request {{(pid=79433) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 21 10:30:03.386852 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7275cff197074a10a2aad87fc5343248', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '395510de8de542388e9d42e99270937b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79433) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 21 10:30:03.387401 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] REQUEST_METHOD: `GET` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 21 10:30:03.387713 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] SCRIPT_NAME: `/identity` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 21 10:30:03.387989 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79433) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 21 10:30:03.389730 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.fernet_utils [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79433) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 21 10:30:03.400307 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 21 10:30:03.401892 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842442ad-e3e4-4849-a596-bef747e6cdc3 service placement] RBAC: Authorization granted {{(pid=79433) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 21 10:30:03.411849 dv-cinder-830091-1-iscsi devstack@keystone.service[79433]: [pid: 79433|app: 0|req: 1448/2889] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Feb 21 10:30:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)